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ABSTRACT 


A  major  problem  which  confronts  the  behavioral  sciences  is 
the  lack  of  a  unifying  set  of  dimensions  for  describing  human  tatk 
performance.  The  absence  of  such  a  system  limits  the  ability  to 
relate  human  performance  observed  in  one  task  to  that  observed 
in  similar  tasks.  There  is  a  need  for  a  well-defined  task-descrip¬ 
tive  language  for  use  by  those  who  must  apply  the  results  of 
research  to  operational  tasks.  This  report  describes  one  of 
reveral  approaches  under  development  as  part  of  a  larger  program; 
the  approach  is  concerned  with  developing  a  task  classification 
system  based  upon  known  parameters  of  human  performance. 

The  human  abilities,  upon  which  this  system  was  based,  were 
derived  primarily  from  the  reported  factor  analyses  of  human  per¬ 
formance  in  the  cognitive,  psychomotor,  physical,  perceptual,  and 
sensory  areas.  Definitions  of  the  abilities  were  developed  together 
with  rating  scales  for  each  ability.  A  series  of  pilot  studies  then 
were  undertaken  with  the  objective  of  producing  an  instrument  which 
would  have  high  reliability  in  classifying  human  tasks.  During 
these  exploratory  studies,  the  initial  set  of  human  abilities  was 
modified,  the  definitions  of  the  abilities  were  revised,  and  the  rating 
technique  was  improved  upon.  In  addition,  the  studies  examined 
various  methods  of  analyzing  the  reliability  data,  and  compared 
two  methods  of  anchoring  the  rating  scales.  The  results  of  this 
pilot  research  indicated  that  it  was  possible  to  develop  a  set  of 
reliable,  ability-based  scales  for  classifying  tasks,  although  more 
work  will  be  needed.  Future  research  on  a  human  ability  approach 
to  classification  will  continue  with  the  investigation  of  the  problems 
of  scale  reliability  and  will  initiate  research  on  questions  of  the 
validity  of  the  class  if icatory  instrument. 
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INTRODUCTION 


A  major  problem  which  confronts  the  behavioral  sciences  is  the 
lack  of  a  unifying  set  of  dimensions  for  describing  human  task  perfor¬ 
mance.  The  absence  of  such  a  system  limits  the  ability  to  relate 
human  performance  observed  in  one  task  to  that  observed  in  similar 
tasks.  At  present,  research  results  obtained  with  one  task  can  safely 
be  generalized  only  to  tasks  which  are  so  highly  similar  as  to  be 
almost  identical;  beyond  this,  generalization  becomes  imprecise  and, 
in  some  instances,  risky.  The  ability  to  communicate  research  find¬ 
ings  is  likewise  limited.  Behavioral  scientists,  and  those  who  must 
apply  research  findings  to  operational  problems  are  without  a  well- 
defined  task  descriptive  language  to  use  in  reporting  and  interpreting 
research  results. 

As  more  and  more  research  is  conducted  and  the  available  re¬ 
search  literature  grows,  the  need  increases  for  a  system  for  classifying 
human  tasks  which  would  permit  dependable  predictions  of  the  effects 
of  independent  variables  on  task  performance  within  and  between 
classes  of  tasks.  The  need  is  especially  great  for  making  most  effective 
use  of  available  data  and  for  predicting  performance  on  new  tasks. 

There  is  a  need  for  a  set  of  unifying  task  dimensions  for  bridging  the 
gap  between  laboratory  research  and  those  human  factors,  training, 
and  design  specialists  who  mu.*  apply  these  findings.  This  need  has 
been  sufficiently  documented  by  Fitts  (1962),  Fleishman  (1962,  1967), 
Melton  and  Briggs  (I960),  and  Miller  (1962). 

One  approach  to  developing  such  a  system  lies  in  the  use  of  known 
parameters  of  human  performance  as  a  basis  for  describing  and  classify¬ 
ing  tasks.  A  major  source  of  information  comes  from  the  literature 
on  human  abilities  identification.  This  extensive  research  has  been 
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based  on  empirically  derived  intercorrelations  among  task  performances 
in  a  variety  of  performance  areas  (e.  g.  ,  cognitive,  psychomotor,  etc.  ). 

Yet,  this  information  has  never  been  tested  for  its  utility  in  describing 
tasks  used  in  the  experimental  literature  on  factors  affecting  human 
performance. 

The  description  of  tasks  in  terms  of  the  types  and  amounts  of  human 
abilities  required  for  task  performance  could  produce  a  classification 
system  within  which  it  is  possible  to  predict  the  effects  of  independent 
variables  in  situations  where  these  effects  have  not  been  experimentally 
measured.  Such  predictions  would  be  based  upon  knowledge  of  the 
effects  of  independent  variables  on  the  performance  of  tasks  requiring 
particular  human  abilities.  Thus,  research  results  might  be  generalized 
between  task  situations  on  the  basis  of  the  degree  of  similarity  among 
the  ability  requirement  profiles  of  the  tasks  involved. 

The  present  report  describes  a  series  of  studies  carried  out  to  x. 

develop  methods  by  means  of  which  observers  can  describe  tasks 
in  terms  of  their  ability  requirements.  The  general  objective  was  to 
provide  an  instrument  which  could  be  utilized  to  describe  both  labo¬ 
ratory  and  operational  tasks  along  a  comprehensive  set  of  specifically 
defined  ability  dimensions. 


* 
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BACKGROUND  AND  OBJECTIVES 


The  present  study  is  part  of  a  larger  program  concerned  with 
developing  a  classification  system  for  human  tasks  (Fleishman,  1967; 
Fleishman,  Kmkade,  &  Chambers,  1968;  Chambers,  1969:  Farina, 

1969;  Theologus,  1969,  Wheaton,  1969).  One  purpose  of  this  effort 
is  to  determine  whether  the  classification  of  tasks  allows  for  increased 
generalization  of  experimental  data  within  and  among  classes  of  tasks. 

As  part  of  this  general  program,  several  provisional  classification 
systems  are  being  developed.  The  present  report  describes  the 
development  of  one  of  these  systems  which  seeks  to  employ  human 
abilities  as  task  descriptors  in  order  to  be  able  to  relate  tasks  or  the 
basts  of  the  salient  behaviors  required  for  task  performance. 

Origin  of  the  Abilities  Approach  to  Classification 

An  examination  of  the  literature  revealed  that  several  classifi¬ 
cation  systems  have  been  developed  which  could  possibly  serve  as 
bases  for  the  present  effort;  these  systems  were  carefully  reviewed 
and  are  reported  elsewhere  (Farina,  1969;  Theologus,  106^:  Wheaton, 

1969).  While  these  reviews  provided  sonic  guidance  to  ibe  present 
effort,  many  of  the  past  classificatory  attempts  were  considered  in¬ 
appropriate  for  the  present  purposes  since  they  were  not  directly 
related  to  the  prediction  of  human  task  performance.  For  example, 
some  systems  arc  primarily  directed  toward  job  analysis,  where, 
according  to  Farina  (1969),  the  basic  unit  of  study  deals  with  a  unit 
larger  than  a  task  (e.  g.  ,  the  job  or  the  totality  of  tasks,  duties,  and 
responsibilities ). 

Other  sources  of  difficulty  arise  in  the  lack  of  operational 
task  definitions.  For  example,  task  categories  like 
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vigilance,  monitoring,  scanning,  or  watch-keeping  may  or  may  not 
represent  the  same  category,  from  one  system  to  the  next;  it  is 
often  difficult  to  tell  since  the  task  behaviors  are  not  always  suffi¬ 
ciently  specified. 

Of  the  remaining  systems,  most  were  either  based  on  categories 
which  were  too  broa  ’  (e.  g.  ,  "decision-making",  "problem-solving") 
or  too  narrow  (e.  g.  ,  "rotates  control  knob").  Past  experience  in 
classification  indicates  that  such  descriptors  do  not  allow  for  depend¬ 
able  prediction  of  human  performance.  The  reason  may  be  that  such 
descriptors  bear  little  relationship  to  what  has  been  experimentally 
established  regarding  human  performance.  The  descriptors  ignore 
our  present  knowledge  as  to  the  nature  and  number  of  human  perfor¬ 
mance  categories.  Present  knowledge  would  indicate  that  broad  cate¬ 
gories  such  as  "problem-solving"  or  "perceptual-motor"  are  not 
unitary  processes  and  that  highly  specific  categories  such  as  "rotates 
knob"  are  not  general  types  of  human  performance.  Thus,  there  is 
reason  to  doubt  that  systems  based  on  categories  such  as  these  will 
be  successful  in  allowing  dependable  predictions  of  human  performance 
from  one  task  to  another. 

For  example,  the  broad  category  of  "pcrccptual-motor"  is  likely 
to  be  relatively  useless  in  generalizing  from  one  "perceptual-motor" 
task  to»the  next.  Knowledge  from  research  on  correlations  among 
human  performances  indicates  a  greater  degree  of  specificity  than 
this  and  a  considerable  diversity  of  function  within  this  category 
(see  Fleishman,  1964).  "Manual  Dexterity",  "Multilimb  Coordination", 
and  "Control  Precision"  are  a  few  examples  of  the  many  perceptual- 
motor  abilities  which  have  been  experimentally  shown  to  underlie  the 
broad  category  of  "perceptual-motor".  Not  only  have  such  abilities 
bi'an  identified,  but  they  also  have  been  found  to  be  related  to  perfor¬ 
mance  in  a  variety  of  human  tasks.  For  example,  "Spatial- Visualization" 
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has  been  shown  to  account  for  performance  in  such  diverse  tasks  as 
aerial  navigation,  blueprint  reading,  and  dentistry.  Put  in  other 
terms,  each  of  these  tasks  is,  in  part,  describable  in  terms  of  that 
component  of  its  performance  which  can  be  attributed  to  the  ability 
of  "Spatial- Visualization’1.  Thus,  in  choosing  a  level  and  basis  for 
task  description  in  terms  of  human  performance,  it  would  appear 
wise  to  capitalize  upon  the  experimental  knowledge  we  already  possess 
concerning  basic  human  abilities. 

Derivation  of  Human  Abilities 


In  order  to  more  fully  understand  the  use  of  human  abilities  in 
task  classification,  it  may  be  useful  to  describe  some  of  the  logic  and 
technique  for  their  derivation  (see  Fleishman,  1967).  Generally,  in 
establishing  a  set  of  abilities,  a  sub-area  of  human  performance  is 
studied  where  tasks  are  specifically  designed  to  tap  certain  hypothesized 
ability  categories.  These  tasks  are  administered  to  samples  of  sub¬ 
jects  and  the  correlations  among  them  are  obtained  and  subjected  to 
factor  analytic  study.  Based  on  this  information,  additional  hypotheses 
are  generated  and  further  studies  are  conducted  to  sharpen  the  definitions 
of  the  categories.  Many  of  these  later  studies  introduce  variations 
in  the  tasks  to  investigate  the  relationships  between  the  task  parameters 
(e.  g.  ,  number  or  nature  of  stimuli)  and  the  ability  requirements.  This 
is  done  through  an  examination  of  correlations  between  performance 
on  reference  measures  and  performance  on  tasks  whose  parameters 
have  been  varied.  The  purpose  of  this  procedure  is  to  define  the  fewest 
independent  ability  categories  which  might  be  most  useful  and  meaningful 
in  describing  performance  in  a  wide  variety  of  tasks. 

It  is  perhaps  not  too  extreme  to  state  that  most  of  the  categori¬ 
zation  of  human  skills,  which  is  empirically  based,  comes  from  such 
correlational  and  factor  analytic  studies.  We  can  think  of  such 
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categories  as  representing  empirically  derived  patterns  of  response 
consistencies  to  task  requirements  varied  in  systematic  ways.  In 
a  sense,  this  approach  describes  tasks  in  terms  of  the  common 
abilities  required  to  perform  them.  The  fact  that  individuals  who  do 
well  on  task  A  also  do  well  on  tasks  B  and  C  but  not  on  tasks  D,  E, 
and  F  indicates,  inferentially,  a  common  process  involved  in  perform¬ 
ing  the  first  three  tasks  distinct  from  the  processes  involved  in  the  latter 
three.  To  account  for  the  observed  consistencies  an  ability  is  postu¬ 
lated.  Once  postulated  in  this  fashion,  the  definition  of  the  ability 
must  then  be  refined  and  its  limits  carefully  specified  by  further 
research. 

The  result  of  this  careful  experimental  process  is  a  set  of  abilities 
which  vary  in  scope  and  specificity.  However,  they  all  provide  insights 
into  the  nature  of  human  performance.  For  example,  it  is  important 
to  know  that  it  is  not  too  useful  to  talk  about  "strength"  as  a  perfor¬ 
mance  dimension.  In  terms  of  what  tasks  the  same  people  can  do  well, 
it  is  more  useful  to  talk  in  terms  of  at  least  three  general  strength 
categories  (Dynamic  Strength,  Static  Strength,  and  Explosive  Strength) 
which  may  be  differentially  involved  in  a  variety  of  physical  tasks 
(see  Fleishman,  1964). 

Purpose  of  the  Present  Research 

Substantial  experimental  effort  has  been  devoted  to  the  identifi¬ 
cation  of  the  basic  human  abilities,  although  the  work  is  not  complete 
in  all  areas  of  human  performance.  The  result  has  been  the  establish¬ 
ment  of  sets  of  abilities  encompassing  much  of  the  cognitive,  perceptual, 
psychomotor,  and  physical  areas  of  performance.  Because  these 
major  areas  of  human  performance  have  already  been  delineated  in 
terms  of  ability  dimensions,  a  significant  step  has  been  taken  toward 
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tile  adequate  coverage  of  the  entire  range  of  human  abilities  which 
may  be  required  for  performance  on  any  type  of  task.  Thus,  abilities 
provide  a  natural  basis  for  describing  and  hence  classifying  tasks 
in  terms  of  human  performance  requirements.  Some  evidence 
already  exists  that  a  classification  system  thus  developed  helps  to 
integrate  a  wide  range  of  behavioral  data  and  phenomena  (Fleishman, 
1967).  However,  we  do  not  yet  know  the  extent  to  which  the  use  of 
such  ability  categories  in  describing  tasks  facilitates  the  generalization 
of  research  results  on  the  effects  of  various  independent  variables 
on  human  performance.  We  also  do  not  know  the  extent  to  which 
these  categories  can  be  used  reliably  by  human  factors  technologists, 
behavioral  scientists,  and  other  specialists  in  describing  human  tasks. 

Before  the  first  of  the  above  problems  can  be  approached,  it 
is  necessary  to  deal  with  the  second.  To  examine  the  second  problem 
a  prototypical  instrument  for  classifying  tasks  on  the  basis  of  ability 
requirements  was  developed.  Both  this  instrument  and  a  modified 
version  of  it  were  then  employed  in  a  series  of  feasibility  studies 
designed  to  provide  an  initial  assessment  of  the  reliability  of  the 
instrument  and  to  uncover  any  areas  which  would  merit  further 
development  or  revision.  This  paper  reports  on  these  activities. 
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DEVELOPMENT  OF  ABILITY  DIMENSIONS 


The  present  research  effort  was  designed  to  accomplish  three 
lim  ted  objectives.  First,  a  set  of  Task  Assessment  Scales  (TAS) 
on  which  tasks  could  be  rated  on  ability  dimensions  was  to  be  developed. 
Second,  to  aid  in  future  research  with  the  TAS,  statistical  techniques 
for  analyzing  the  data  were  to  be  examined  and  evaluated.  Third,  a 
preliminary  determination  was  to  be  made  as  to  whether  judges  could 
agree  on  the  rating  of  tasks  by  means  of  the  TAS. 

Development  of  the  TAS 

Generation  of  ability  lists.  The  first  step  in  the  development  of 
the  TAS  was  the  derivation  of  a  list  of  abilities  upon  which  tasks  could 
be  rated.  In  addition,  each  of  these  abilities  had  to  be  defined  so  that 
it  could  be  unambiguously  communicated  to  a  panel  of  judges.  In 
order  to  derive  such  a  list  of  abilities,  a  literature  review  was  con¬ 
ducted  to  determine  the  cognitive,  perceptual,  and  psychomotor  ability 
factors  which  have  been  identified  in  rather  extensive  factor-analytic 
studies. 

For  the  cognitive  and  perceptual  domains  the  primary  sources 
of  reference  were  Guilford1 8  work  (1967)  on  the  nature  of  the  intellect, 
and  French's  work  (1  951,  1963)  on  cognitive  and  perceptual  reference 
tests  and  factors. 

From  these  sources,  a  set  of  19  abilities  was  selected  based 
upon  the  criterion  that  each  ability  was  identified  in  a  minimum  of 
ten  individual  studies.  A  definition  for  ea^h  of  these  19  abilities  was 
developed  by  integrating  French  s  definition  for  a  given  ability  with 
Guilford*  s  definition  of  the  equivalent  ability.  Included  in  each 
definition  were  examples  of  tests  w'hich  possessed  the  highest  loadings 
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on  each  factor.  This  step  permitted  further  specifications  of  the  19 
definitions. 

With  respect  to  the  psychomotor  area,  a  set  of  abilities  was 
selected  from  those  factors  analytically  established  by  Fleishman 
(e.  g.  ,  Fleishman,  1954,  1958,  I960,  1962).  The  definitions  employed 
for  these  abilities  were  essentially  those  provided  by  Fleishman. 

Again,  as  in  the  cognitive  and  perceptual  areas,  representative  tasks 
were  included  as  examples  with  each  definition. 

These  psychomotor  abilities  were  merged  into  a  single  list  with 
the  cognitive  and  perceptual  abilities  and  this  preliminary  list  was 
reviewed  by  AIR  personnel  for  their  comments.  A  series  of  interviews 
and  discussions  among  members  of  the  staff  revealed  a  number  of 
areas  that  merited  further  consideration.  These  included:  a)  the 
need  for  a  more  comprehensive  ability  list;  b)  the  need  to  clarify 
vague  and  ambiguous  definitions;  and  c)  the  need  to  provide  additional 
examples.  In  response  to  these  comments,  several  actions  were 
taken.  The  preliminary  abilities  list  was  expanded  to  incorporate 
sensory  and  physical  proficiency  abilities.  These  latter  abilities 
were  derived  from  work  by  Fleishman  (e.  g.  .  Fleishman,  1963,  2  964). 
Second,  an  attempt  was  made  to  carefully  delineate  the  extent  and 
limits  of  each  ability  in  the  list.  Third,  additional  examples  were 
included  in  the  ability  definitions  to  better  illustrate  the  abilities. 

In  still  another  effort  to  sharpen  the  abilities  list,  a  variety  of 
experimental  studies  was  reviewed  in  order  to  determine  whether 
any  obvious  areas  of  performance  were  not  represented  in  the  ability 
list.  From  this  review  it  became  apparent  that  the  list  was  still 
incomplete  since  some  task  elements  could  not  be  analyzed  in  terms 
of  the  existing  ability  list.  Recognition  of  this  fact  led  to  the  inclusion 


of  a  group  of  abilities  which  have  not  been  studied  to  any  great  extent, 
but  which,  nevertheless,  appear  to  have  wide  applicability  to  human 
performance  (e.  g.  ,  time -sharing  and  attention).  The  result  of  these 
efforts  was  a  list  of  49  abilities  with  definitions  and  examples  for 
each  (Table  1,  Appendix  A). 

In  addition  to  this  list  of  specific  abilities,  a  list  of  12  general 
abilities  was  constructed  (Table  2,  Appendix  A).  The  purpose  of 
this  second  list  was  to  determine  whether  a  wide  variety  of  tasks 
could  be  effectively  analyzed  using  fewer  but  broader  ability  categories. 
This  list  was  developed  by  collapsing  many  of  the  similar  specific 
abilities  into  more  general  descriptors.  For  instance,  Associative 
Memory-Meaningful  Pairings  and  Associative  Memory-Arbitrary 
Pairings  were  collapsed  into  the  single  category  of  Memory. 

Selection  of  task  descriptions.  In  order  to  further  refine  the 
two  ability  lists,  a  sample  of  judges  next  rated  a  set  of  task  descrip¬ 
tions,  utilizing  rating  scales.  For  each  ability,  the  rater  was  re¬ 
quired  to  rate  the  degree  to  which  that  ability  was  required  by  that 
task.  The  task  descriptions  were  obtained  from  a  review  of  experi¬ 
mental  journals  and  technical  reports. 

The  task  selection  process  was  based  upon  several  criteria: 

(1 )  completeness  of  task  descriptions,  (2)  range  of  behaviors  sampled, 
and  (3)  a  balance  between  "real  world"  and  laboratory  tasks.  A 
rough  categorization  of  the  set  of  task  descriptions  produced  by  this 
literature  search  is  shown  in  Table  1.  The  three  "real  world"  tasks 
employed  a  task  analysis  format  in  which  the  task  procedures  were 
presented  in  a  step  -by-step  fashion.  The  three  laboratory  tasks  were 
described  in  paragraphs  which  included  information  on  subjects, 
apparatuses  and  procedures. 


-11- 


TABLE  1 


Task  Descriptions  Employed  in  Developing 
Preliminary  Form  of  the  TAS 


Task  Title 


Type 


Performance  Category 


Computer  programmer 
Fire  control  leader 
Sheet  metal  worker 
Problem  similarity 
Letter  recognition 
Polar  pursuit 


Real  world 
Real  world 
Real  world 
Laboratory 
Laboratory 
Laboratory 


Cognitive 

Cognitive  /  Psychomotor 

Psychomotor 

Cognitive 

Cognitive/  Psychomotor 
Psychomotor 


Test  of  original  TAS.  To  rate  the  task  descriptions  on  the  ability 
scales  a  sample  of  18  professional  personnel  from  the  American 
Institutes  for  Research  in  Washington,  D.  C.  were  selected  to  serve 
as  judges.  The  18  individuals  were  randomly  assigned  to  one  of  two 
groups.  The  members  of  one  group  received  the  general  ability  list 
(12  descriptors)  while  the  members  of  the  other  group  received  the 
specific  ability  list  (49  descriptors).  Each  judge  also  received  the 
set  of  six  task  descriptions  and  six  scoring  forms  on  which  to  rate 
each  of  the  tasks.  The  18  AIR  judges  rated  each  of  the  six  tasks  on 
each  of  the  abilities  in  the  list  which  they  had  been  assigned.  The 
ratings  were  made  by  first  scoring  an  ability  as  present  or  absent 
in  a  given  task  and  then,  for  those  abilities  rated  as  present,  by 
determining  whether  the  ability  was  "critical"  if  it  contributed  to 
individual  differences  in  performance.  Although  these  data  were 
analyzed,  of  primary  importance  were  the  opinions  of  the  judges  con¬ 
cerning  the  adequacy  and  comprehensiveness  of  the  scales.  To  obtain 
these  opinions  two  steps  were  taken.  First,  each  judge  was  asked 
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to  make  written  notes  as  he  attempted  to  employ  the  scales.  In 
addition,  each  judge  was  interviewed  and  his  verbal  comments  and 
impressions  were  obtained. 

In  general,  the  results  of  this  small  scale  examination  of  the 
TAS,  coupled  with  the  judges'  comments,  indicated  that  the  abilities 
approach  to  task  classification  was  feasible.  A  comparison  of  the 
data  obtained  from  the  application  of  the  two  ability  lists  showed  that 
the  specific  list  (49  abilities)  allowed  for  a  more  detailed  and 
thorough  analysis  of  the  task  descriptions  without  any  loss  in  inter¬ 
judge  agreement.  This  finding  was  reinforced  by  the  verbal  and 
written  comments  of  the  judges. 

Further  analysis  of  the  judges'  comments  revealed  two  additional 
areas  which  deserved  consideration: 

1.  the  need  to  modify  the  specific  ability  definitions  so  as 
to  reduce  apparent  overlap  among  them,  and 

2.  the  need  to  modify  memory  abilities  since  they  appeared 
to  inadequately  represent  the  memory  area. 

Revision  of  the  TAS* 

Based  upon  the  comments  and  the  data  discussed  above,  the 
general  ability  list  was  eliminated  from  further  consideration,  and 
it  was  decided  to  focus  future  efforts  on  the  specific  list.  However, 
based  on  the  judges'  comments,  several  changes  were  made  in  the 
specific  list.  First,  the  definitions  of  those  abilities,  which  were 
most  often  confused  with  other  abilities,  were  revised  so  as  to 
emphasize  the  extent  and  limit  cf  each  ability.  During  this  revision. 


1 


The  revised  TAS  can  be  found  in  Appendix  B. 


care  was  taken  to  stress  the  distinctions  among  abilities.  In  addition, 
when  an  ability's  label  (or  name)  was  noted  by  the  judges  as  being 
confusing  with  respect  to  its  definition,  the  label  was  changed  to 
better  represent  the  definition. 

Second,  the  original  ability  list  contained  only  two  memory 
abilities  which  the  judges  felt  were  inadequate  for  rating  tasks  in 
which  a  memory  function  was  required.  In  order  to  revise  and  ex¬ 
pand  the  memory  area,  a  literature  review  of  memory  studies  (e.  g.  , 
Christal,  1968;  Kelley,  1964;  Guilford,  1967)  was  conducted.  This 
review  yielded  five  memory  functions  which  were  felt  to  be  logically 
distinct. 

Third,  the  instructions  originally  given  to  the  18  AIR  judges 
were  singled  out  for  attention,  since  they  were  considered  to  be  too 
general  in  nature.  In  an  attempt  to  remedy  this  situation,  a  detailed 
explanation  of  the  abilities  approach  to  classification  was  developed. 
Major  sections  included  in  this  explanation  were:  (1)  a  background 
and  rationale  for  the  approach,  (2)  a  description  of  the  materials 
to  be  used,  and  (3)  a  schema  for  applying  the  abilities  to  tasks  as 
well  as  criteria  for  their  application.  These  more  detailed  instructions 
were  incorporated  into  the  revision  of  the  TAS. 


FIRST  PILOT  STUDY 


Design 

Once  the  TAS  had  been  revised,  a  pilot  study  was  designed  to 
reassess  the  TAS,  to  evaluate  statistical  methods  for  analyzing  the 
data,  and  to  determine,  in  a  preliminary  fashion,  whether  the  judges 
could  agree  on  the  rating  of  the  abilities  required  for  performance 
on  a  given  tas^ 

A  set  of  six  tasks  was  selected  for  the  pilot  study.  These  tasks 
are  listed  in  Table  2,  and  the  complete  task  descriptions  can  be  found 
in  Appendix  B.  Three  of  these  tasks  (sheet  metal  worker,  polar 
pursuit,  and  letter  recognition)  were  the  same  as  those  used  in  the 
exploratory  effort,  described  above,  to  refine  the  TAS.  Three  new 
tasks  (astronaut,  air  traffic  controller,  and  helicopter  pilot)  were 
chosen  to  maintain  the  balance  between  "real  world"  and  laboratory 
tasks. 


TABLE  2 

Task  Descriptions  Used  in  the  Pilot  Study 


Task  Title 


Type 


Performance  Category 


Sheet  metal  worker 
Air  traffic  controller 
Helicopter  pilot 
Polar  pursuit 
Letter  recognition 
Astronaut 


Real  world 
Real  world 
Real  world 
Laboratory 
Laboratory 
Laboratory 


Psychomotor 

Cognitive 

Cognitive  /  Psychomotor 

Psychomotor 

Cognitive 

Cognitive  /  Psychomotor 


I 

The  subjects  selected  for  the  pilot  study  consisted  of  25  judges 
from  AIR  and  60  judges  from  outside  AIR.  The  outside  judges  were  « 

chosen  from  the  membership  of  the  Division  of  Evaluation  and 
Measurement  (Division  5)  of  the  American  Psychological  Association 
(APA).  Each  of  the  APA  judges  was  a  well-known  expert  in  the  field 
of  psychological  measurement.  Of  these  60  judges,  32  completed  and 
returned  the  kits  which  were  mailed  to  them. 

Each  of  the  AIR  judges  received  a  kit  consisting  of  the  TAS  and 
a  set  of  six  task  descriptions,  to  be  assessed  in  the  order  in  which 
they  were  presented.  This  order  of  presentation  was  randomized. 

The  APA  judges  received  a  similar  kit  except  that  the  number  of 
task  descriptions  was  reduced  to  three  in  order  to  lighten  the  work¬ 
load  and  thereby  increase  the  number  of  returns.  The  assessment 
of  the  full  set  of  six  task  descriptions  required  approximately  five 
hours.  The  judges  were  required  to  rate  each  of  the  tasks  on  each 
of  the  abilities  as  "Not  Involved",  "Base-line",  or  "Critical". 

"Base-line"  was  defined  as  the  amount  of  the  ability  that  an  average  + 

person  would  exhibit.  "Critical"  was  defined  as  being  above  base¬ 
line;  that  is,  the  average  person  would  not  exhibit  the  amount  of  the 
ability  required. 

Analysis  and  Results 

The  data  derived  from  the  pilot  study  were  analyzed  by  means 
of  intraclass  correlation  coefficients  (iv)  (Winer,  1962,  p.  126)  and 
percentage  distributions  of  the  judges'  ratings  to  determine  inter¬ 
judge  reliability  on  specific  ability  scales,  and  by  means  of  similarity 

coefficients  (r  )  (Cattell  it  Coulter,  1966)  to  determine  the  similarity 
~ P 

between  pairs  of  task  ability  profiles. 
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In  computing  the  r^  values  for  each  ability,  the  judges  were 
treated  as  three  groups:  (1)  the  AIR  judges  (n  =  25)  who  rated  all 
six  tasks,  (2)  the  APA  judges  (n  =  16)  who  rated  tasks  1,  2,  and  4, 
and  (3)  the  APA  judges  (n  =  16)  who  rated  tasks  3,  5,  and  6.  In 
addition  to  the  r^  values,  the  derived  coefficients  for  the  reliability 
of  a  group  of  five  judges  (r^)  and  for  the  reliability  of  a  single  judge 
(r^)  were  also  calculated.  Both  r^  and  r^  are  relevant  to  this  study 
since  they  bear  on  the  future  use  of  the  TAS.  If  the  TAS  is  to  be 
employed  by  groups  of  judges,  then  r^  would  be  an  appropriate 
reliability  estimate.  If  the  TAS  is  tc  be  used  by  a  single  judge,  then 
r^  would  be  appropriate. 

The  r,  data  are  shown  in  Table  3  and  the  r _  and  r,  data  are 
k  5  1 

shown  in  Table  4.  In  general,  these  data  reveal  that  a  large  number 
of  the  scales  show  high  reliabilities  when  large  groups  of  raters 
are  used  but  that  they  cannot  be  employed  reliably  either  by  small 
groups  of  five  judges  (r^)  or  by  individual  judges  (r^).  Only  Ability 
26,  Control  Precision,  showed  any  consistent  reliability  across  all 
three  groups  of  judges. 

To  obtain  insight  into  the  exact  nature  of  the  reliabilities  reflected 
by  the  r^  s,  the  distributions  of  the  judges'  ratings  of  each  task,  on 
each  ability,  were  examined  by  calculating  the  percentage  of  judges 
who  rated  the  task  as  a  "aero",  "one",  or  "two".  For  the  purposes 
of  this  analysis,  "agreement"  was  arbitrarily  defined  as  80%  or  more 
of  the  judges  rating  a  given  task,  on  a  given  ability,  in  exactly  the 
same  fashion.  This  is  admittedly  a  stringent  criterion,  but  it  is 
felt  that  this  is  necessary  if  the  scales  are  to  be  used  in  later  phases 
of  the  research  program. 
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ABILITY 

1. 

Verbal  Coop  rehens  ion 

2. 

Assoclatlonal  Fluency 

3. 

Word  Fluency 

4. 

Serial  Recall 

5. 

Free  Recall 

6. 

Paired  Associate  Memory 

7. 

Memory  for  Operations 

8. 

Memory  for  Ideas 

9. 

Symbolic  and  Semantic  Ordering 

10. 

Ideational  Fluency 

11. 

Originality 

12. 

Category  Flexibility 

13. 

Induction 

14. 

Syllogistic  Reasoning 

15. 

Arithmetic  Reasoning 

1 6. 

Number  Facility 

17. 

Problem  Sensitivity 

18. 

Flexibility  of  Closure 

19. 

Perceptual  Speed 

20. 

Spatial  Orientation 

21. 

Spatial  Scanning 

22. 

Visualization 

23. 

Auditory  Perceptual  Speed 

24. 

Auditory  Rhythm  Discrimination 

25. 

Arm-Hand  Steadiness 

26. 

Control  Precision 

27. 

Finger  Dexterity 

28. 

Manual  Dexterity 

29. 

Multilimb  Coordination 

30. 

Rate  Control 

31. 

Reaction  Time 

32. 

Speed  of  Arm  Movement 

33. 

Response  Orientation 

34. 

Wrist-Finger  Speed 

35. 

Verbal  Expression 

36. 

Attention 

37- 

Time  Sharing 

38. 

Explosive  Strength 

39. 

Static  Strength 

40. 

Dynamic  Strength 

41. 

Extent  Flexibility 

42. 

Dynamic  Flexibility 

43. 

Gross  Body  Equilibrium 

44. 

Gross  Body  Coordination 

45. 

Stamina 

46. 

Depth  Perception 

47. 

Color  Discrimination 

48. 

Near  Visual  Acuity 

49. 

Far  Visual  Acuity 

50. 

Kinesthetic  Discrimination 

TABLE  3 

Reliabilities  fr^)  for  the  Three 
Groups  of  Judges  on  Each  Ability  Scale 


AIR  Judges 
(Tasks  1  to  6) 

r25 


APA  Judges 
(Tasks  1,2,  4) 

rl6 

— 

APA  Judges 
Tasks  3,  5#  6) 

rl6 

.67 

.74 

.69 

.47 

.67 

.49 

.92 

.79 

.82 

.84 

00 

CO 

.90 

•  93 

.73 

.86 

.88 

tr\ 

00 

.78 

.00 

.49 

.22 

1.00 

.38 

.78 

.68 

.69 

.65 

.18 

•  93 

.84 

•  96 

.24 

.93 

.95 

•  75 

.95 

.00 

.89 

.87 

.95 

.93 

.92 

.95 

.88 

.76 

.89 

.00 

.88 

.97 

•  9? 

.98 

•  98 

.77 

.88 

.91 

•  92 

.00 

.97 

.9? 

.94 

.69 

.93 

.92 

.66 

.07 

•  93 

.67 

.00 

.98 

.78 

.16 

.88 

.88 

| 

.97 

.00 

.19 

.00 

.84 

.00 

.75 

.00 

.84 

.00 

.90 

.00 

.93 

.00 

.89 

.68 

•  78 

.00 

.99 

.00 

.97 

.00 

.00 

00 

'O 

.98 

.52 

.91 

TABLE  4 


t 


Group  (£5)  and  Individual  (r^)  Reliabilities 
Per  Each  Ability  Scale 


ABILITY 

AIR  Judges 
(Tasks  1  to  6) 

A  PA 

(Tasks 

Judges 

1.2.4) 

I  A  PA  Judges 

1  (Tasks  3.5.6) 

r5 

r 

1 

r 

5 

ri 

— . 

1  r 

5 

rl 

1. 

Verbal  Con^p  rehens  Ion 

.33 

.09 

.39  : 

.11 

j  .47 

.15 

2. 

Assoc lational  Fluency 

.00 

.00 

.41 

.12 

1  .21 

.05 

3. 

Word  Fluency 

.08 

.02 

.39 

.11 

.23 

.06 

4. 

Serial  Recall 

.31 

.08 

.77 

.40 

.54 

.19 

5. 

Free  Recall 

.43 

.13 

.58 

.22 

.62 

.25 

6. 

Paired  Associate  Memory 

.70 

.32 

.70 

.32 

.73 

.35 

7. 

Memory  for  Operations 

.62 

.25 

.81 

.46 

.46 

.15 

8. 

Memory  for  Ideas 

.37 

.11 

.66 

.28 

.69 

.31 

9. 

Symbolic  and  Semantic  Ordering 

•  57 

.21 

.63 

.27 

•53 

.18 

10. 

Ideational  Fluency 

.12 

.02 

.00 

.00 

.23 

.06 

11. 

Originality 

.27 

.07 

.08 

.02 

1  1.00 

1.00 

12. 

Category  Flexibility 

.00 

.00 

.16 

.04 

.52 

.15 

13. 

Induction 

.44 

.13 

.40 

.12 

.40 

.12 

14. 

Syllogistic  Reasoning 

.59 

.22 

•  37 

.10 

.06 

.01 

15. 

Arithmetic  Reasoning 

.75 

.37 

.82 

.47 

.62 

.25 

16. 

Number  Facility 

.62 

.25 

.88 

.59 

.09 

.02 

17. 

Problem  Sensitivity 

.82 

.48 

.81 

.46 

.87 

.57 

18. 

Flexibility  of  Closure 

.68 

.30 

•  53 

.18 

.82 

.52 

19. 

Perceptual  Speed 

.40 

.12 

.00 

.00 

.73 

.35 

20. 

Spatial  Orientation 

.78 

.41 

.67 

.29 

.85 

.52 

21. 

Spatial  Scanning 

.74 

.36 

.81 

.46 

.79 

.43 

22. 

Visualizat Ion 

.66 

.28 

.85 

.52 

•  69 

.31 

23. 

Auditory  Perceptual  Speed 

.68 

.29 

.49 

.16 

.72 

.34 

24. 

Auditory  Rhythm  Discrimination 

.46 

.14 

.00 

.70 

.32 

25. 

Arm-Hand  Steadiness 

.72 

.34 

.91 

•  66 

.77 

.41 

26. 

Control  Precision 

.89 

.61 

.94 

.75 

.94 

.78 

27. 

Finger  Dexterity 

.67 

.29 

1  .51 

.17 

.69 

.31 

28. 

Manual  Dexterity 

.79 

.42 

.75 

.38 

•  77 

.41 

29. 

Multilimb  Coordination 

.92 

.68 

.00 

.90 

.6  5 

30. 

Rate  Control 

.88 

•  58 

.52 

.84 

.52 

31. 

Reaction  Time 

.48 

.16 

.12 

.81 

.45 

32. 

Speed  of  Arm  Movement 

.34 

.09 

.43 

.38 

.11 

33. 

Response  Orientation 

.64 

.26 

.00 

.81 

.46 

34. 

Wrist-Finger  Speed 

.29 

•  07 

.11 

.00 

.00 

35. 

Verbal  Expression 

•  79 

.42 

.93 

.72 

.52 

.18 

36. 

Attention 

•  57 

.21 

.06 

.01 

.72 

.32 

37. 

Time  Sharing 

.78 

.41 

.69 

.31 

.90 

.63 

38. 

Explosive  Strength 

1  .35 

.10 

.00 

.00 

.07 

.01 

39. 

Static  Strength 

.77 

.40 

.00 

.00 

.61 

.24 

40. 

Dynamic  Strength 

.54 

.19 

.00 

.00 

.49 

.16 

41. 

Extent  Flexibility 

.47 

.15 

.00 

.00 

.61 

.24 

42. 

Dynamic  Flexibility 

.35 

.10 

.00 

.00 

.74 

.36 

43. 

Gross  Body  Equilibrium 

.58 

.21 

.00 

.00 

.81 

•  47 

44. 

Gross  Body  Coordination 

.47 

.15 

.00 

.00 

.72 

.35 

45. 

Stamina 

.31 

.08 

.00 

.00 

.52 

.18 

46. 

Depth  Perception 

•  75 

.37 

.00 

.00 

.97 

.86 

47. 

Color  Discrimination 

.67 

.29 

.00 

.00 

.91 

.67 

48. 

Near  Visual  Acuity 

.03 

.02 

.00 

.00 

.00 

.00 

49. 

Far  Visual  Acuity 

■ 

.59 

.40 

.12 

.93 

.71 

50. 

Kinesthetic  Discrimination 

| 

.40 

j 

.25 

.06 

.75 

.37 
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Table  5  presents  the  percentage  distributions  for  the  ratings 
made  by  both  the  AIR  judges  and  the  outside  judges  on  each  ability 
for  Task  1.  Tables  6  through  10  present  similar  distributions  for 
the  remaining  five  tasks.  Since  the  information  contained  in  Table  5 
is  representative  of  the  ability  by  ability  "agreement"  data  shown 
in  Tables  5  through  10,  the  following  discussion  will  be  confined  to 
this  table.  An  inspection  of  Table  5  reveals  that  "agreement"  was 
reached  on  other  than  a  zero  rating  in  two  instances  by  the  AIR 
judges  and  in  three  instances  by  the  APA  judges.  For  the  AIR 
judges  "agreement"  on  other  than  a  zero  rating  occurred  on  Abili¬ 
ties  26  and  30  (Control  Precision  and  Rate  Control).  This  occurred 
for  the  APA  judges  on  Abilities  25,  26,  and  30  (Arm-Hand  Steadiness, 
Control  Precision,  and  Rate  Control).  This  imbalance  in  "agreement" 
between  zero  and  non-zero  (one  and  two)  ratings  occurred  not  only  on 
Task  1  but  on  all  of  the  tasks  except  Task  5  where  "agreement"  was 
low  even  on  the  rating  of  zero.  The  number  of  times  "agreement" 
was  achieved  across  all  of  the  tasks  is  shown  in  Table  11. 

In  addition  to  determining  the  extent  of  "agreement"  on  specific 
abilities,  the  data  were  analyzed  to  determine  the  degree  of  similarity 
between  pairs  of  ability  profiles  on  each  of  the  tasks.  The  statistic 
r  was  used  for  this  purpose.  For  each  sample  of  judges  and  on 
each  task  a  value  of  r  was  calculated  for  every  pair  of  profiles. 

For  the  AIR  judges,  there  were  300  such  possible  pairs  on  each  of 
the  tasks  and  for  the  outside  judges  there  were  120  possible  pairs  on 
each  task.  Table  12  gives  the  number  of  significant  positive  values 
of  Tp  which  were  found  on  each  of  the  tasks.  This  table  also  indi¬ 
cates  the  proportion  of  the  total  number  of  relationship?  which  are 
represented  by  the  significant,  positive  values  of  r  .  For  those 
unfamiliar  with  the  rp  statistic,  it  ranges  in  value  from  -1.  0  to 
+  1.  0  being  asymptotic  with  respect  to  -1.  0.  An  r  value  of  +1.  0  means 


TABLE  5 

Percentage  Distributions  of  the 
Ratings  Given  to  Task  1 
On  Each  of  the  Fifty  Abilities 


I - 

Percent  of  Judges  in  each  Rating  Category 

ABILITY 

AIR  Judges 

APA 

Judges 

Zero 

One 

Tvc 

Zero 

One 

Two 

1. 

Verbal  Comprehension 

36 

64 

0 

mm 

69 

0 

2. 

Assooiational  Fluency 

96 

4 

0 

mm 

6 

0 

3. 

Word  Fluency 

0 

0 

6 

0 

4. 

Serial  Recall 

8o 

20 

0 

12 

0 

5. 

Free  Recall 

92 

8 

0 

12 

0 

6. 

Paired  Associate  Memory 

84 

12 

4 

88 

12 

0 

7. 

Memory  for  Operations 

44 

52 

4 

44 

56 

0 

8. 

Memory  for  Ideas 

76 

20 

4 

56 

44 

0 

9. 

Symbolic  and  Semantic  Ordering 

76 

24 

0 

88 

12 

0 

10. 

Ideational  Fluency 

100 

0 

0 

88 

12 

0 

11. 

Originality 

96 

4 

0 

94 

6 

0 

12. 

Category  Flexibility 

0 

0 

88 

12 

0 

13. 

Induction 

88 

12 

0 

88 

81 

12 

0 

14. 

Syllogistic  Reasoning 

100 

0 

0 

19 

0 

15. 

Arithmetic  Reasoning 

or> 

y  *- 

8 

0 

88 

12 

0 

16. 

Number  Facility 

92 

8 

0 

88 

12 

0 

17- 

Problem  Sensitivity 

6o 

36 

4 

88 

12 

0 

18. 

Flexibility  of  Closure 

52 

32 

16 

38 

62 

0 

19. 

Perceptual  Speed 

52 

16 

32 

38 

31 

31 

20. 

Spatial  Orientation 

56 

16 

28 

25 

50 

25 

21. 

Spatial  Scanning 

68 

16 

16 

38 

50 

12 

22. 

Visualization 

64 

8 

28 

50 

32 

18 

23. 

Auditory  Perceptual  Speed 

96 

4 

0 

82 

6 

12 

24. 

Auditory  Rhythm  Discrimination 

100 

0 

0 

82 

12 

6 

25. 

Arm-Hand  Steadiness 

28 

16 

56 

0 

18 

82 

26. 

Control  Precision 

8 

12 

8 

6 

6 

88 

27- 

Finger  Dexterity 

40 

48 

12 

31 

1  38 

31 

28. 

Manual  Dexterity 

40 

,  44 

16 

12 

!  44 

44 

29. 

Multilimb  Coordination 

84 

16 

0 

76 

12 

12 

30. 

Rate  Control 

8 

8 

84 

0 

100 

31. 

Reaction  Time 

3  6 

20 

6 

7  6 

32. 

Speed  of  Arm  Movement 

32 

44 

■ 

6 

37 

33. 

Response  Orientation 

52 

28 

u 

18 

25 

34. 

Wrist-Finger  Speed 

56 

28 

25 

31 

35- 

Verbal  Expression 

96 

4 

94 

6 

0 

36. 

Attention 

16 

44 

40 

6 

44 

50 

37. 

Time  'Sharing 

64 

36 

0 

69 

25 

6 

38. 

Explosive  Strength 

96 

4 

0 

88 

12 

0 

39- 

Static  Strength 

96 

4 

wm 

88 

12 

0 

40. 

Dynamic  Strength 

96 

0 

■ 

69 

25 

6 

41. 

Extent  Flexibility 

92 

8 

1 

81 

19 

0 

42. 

Dynamic  Flexibility 

92 

0 

8 

63 

31 

6 

43. 

Gross  Body  Equilibrium 

92 

8 

fm 

63 

31 

6 

44. 

Gross  Body  Coordination 

96 

4 

1 

63 

31 

6 

45- 

Stamina 

100 

0 

n 

69 

31 

0 

46. 

Depth  Perception 

52 

32 

16 

38 

50 

12 

47- 

Color  Discrimination 

44 

3  6 

20 

75 

19 

6 

48. 

Near  Visual  Acuity 

24 

44 

32 

19 

62 

19 

49- 

Far  Visual  Acuity 

72 

24 

n 

56 

44 

0 

50. 

Kinesthetic  Discrimination 

88 

12 

H 

75 

19 

6 
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TABLE  6 

Percentage  Dls trlbutions  of  the 
Rating  Given  to  Task  2 
On  Each  of  the  Fifty  Abilities 


ABILITY 

Percent  of  Judges  in  each  Rating  Category  j 

AIR  Judges 

APA  Judges 

Zero 

One 

Two 

Zero 

One 

- 1 

Two 

I  1. 

Verbal  Comprehension 

24 

72 

4 

13 

56 

31 

1  2. 

Associational  Fluency 

84 

16 

0 

63 

25 

12 

3. 

Word  Fluency 

88 

8 

4 

69 

25 

6 

4. 

Serial  Recall 

44 

40 

16 

19 

50 

31 

5. 

Free  Recall 

48 

44 

8 

37 

44 

19 

6. 

Paired  Associate  Memory 

32 

32 

36 

31 

50 

1? 

7- 

Memory  for  Operations 

8 

28 

64 

0 

37 

63 

8. 

Memory  for  Ideas 

64 

0 

12 

63 

25 

9. 

Symbolic  and  Semantic  Ordering 

28 

, 

36 

36 

44 

31 

25 

10. 

Ideational  Fluency 

84 

12 

4 

75 

13 

12 

1J. 

Originality 

76 

20 

4 

75 

19 

6 

12. 

Category  Flexibility 

84 

16 

0 

69  J 

25 

6 

13. 

Induction 

64 

16 

20 

50 

37 

13 

14. 

Syllogistic  Reasoning 

68 

16  1 

16 

56 

44 

0 

15. 

Arithmetic  Reasoning 

24 

28 

48 

19 

25 

56 

16. 

Number  Facility 

16 

40  i 

44 

6 

19 

75 

17- 

Problem  Sensitivity 

8 

28 

64 

19 

18 

63 

18. 

Flexibility  of  Closure 

8 

48  : 

44 

19 

25 

56 

19. 

Perceptual  Speed 

48 

20 

32 

25 

31 

44 

20. 

Spatial  Orientation 

12 

24 

64 

0 

25 

75 

21. 

Spatial  Scanning 

8 

28  i 

64 

0 

25 

75 

22. 

Visualization 

12 

32  j 

5  6 

6 

7 

87 

23. 

Auditory  Perceptual  Speed 

40 

28 

I 

32 

44 

19 

37 

24. 

Auditory  Rhythm  Discrimination 

88 

12 

0 

75 

13 

12 

25- 

Arm-Hand  Steadiness 

80 

16 

4 

75 

19 

6 

26. 

Control  Precision 

84 

8 

8 

75 

19 

6 

27- 

Finger  Dexterity 

92 

8 

0 

75 

19 

6  ; 

28. 

Manual  Dexterity 

92 

8  i 

0 

81 

13 

6  1 

29. 

Multilimb  Coordination 

100 

0  i 

0 

81 

13 

6 

30. 

Rate  Control 

88 

8  1 

4 

50 

19 

31 

31. 

Reaction  Time 

48 

40  1 

12 

31 

32 

37 

32. 

Speed  of  Arm  Movement 

84 

16 

0 

81 

13 

6 

33. 

Response  Orientation 

48 

28 

24 

18 

19 

63  i 

34. 

Wrist-Finger  Speed 

92 

8 

0 

81 

13 

6  1 

35. 

Verbal  Expression 

28 

28 

44 

6 

50 

44 

36. 

Attention 

8 

28 

64 

0 

25 

75 

37. 

Time  Sharing 

20 

16 

64 

18 

19 

63  ' 

38. 

Explosive  Strength 

100 

0 

0 

87 

13 

0 

39- 

Static  Strength 

100 

0 

0 

81 

19 

0  1 

40. 

Dynamic  Strength 

100 

0 

0 

75 

25 

0 

41. 

Extent  Flexibility 

100 

0 

0 

81 

19 

0  ; 

42. 

Dynamic  Flexibility 

100 

0 

0 

81 

19 

0 

43. 

Gross  Body  Equilibrium 

100 

1 

0 

0 

81 

19 

0 

44. 

Gross  Body  Coordination 

100 

0 

0 

81 

13 

6  1 

45. 

Stamina 

100  1 

0 

0 

69 

26 

0 

46. 

Depth  Perception 

60 

32 

8 

69 

19 

12 

47- 

Color  Discrimination 

72 

24 

4 

81 

19 

0 

48. 

Near  Visual  Acuity 

4 

68 

28 

6 

75 

19 

49. 

Far  Visual  Acuity 

64 

32 

4 

13 

81 

6  1 

50. 

Kinesthetic  Discrimination 

88 

8 

4 

87 

7 

6  J 

-22- 
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TABLE  7 

Percentage  Distributions  of  the 
Ratings  Qiven  to  Task  3 
On  Each  of  the  Fifty  Abilities 


Percent  of  Judges  in  each  Rating  Category 


ABU 

[jITY 

AIR  JUDGES  | 

APA  JUDGES 

Zero 

One 

Two 

Zero 

One 

Two 

1. 

Verbal  Comprehension 

6o 

40 

0 

69 

r  31 

0 

2. 

Assoc iational  Fluency 

100 

0 

0 

100 

0 

0 

3. 

Word  Fluency 

100 

0 

0 

0 

0 

4. 

Serial  Recall 

68 

20 

12 

63 

37 

c 

5. 

Free  Recall 

88 

8 

4 

100 

0 

0 

6. 

Paired  Associate  Memory 

96 

4 

0 

100 

0 

0 

7. 

Memory  for  Operations 

28 

36 

36 

19 

44 

37 

8. 

Memory  for  Ideas 

7  6 

24 

0  1 

87 

13 

0 

9. 

Symbolic  and  Semantic  Ordering 

84 

4 

75 

25 

0 

10. 

Ideational  Fluency 

100 

0 

100 

0 

0 

11. 

Originality 

96 

0 

100 

0 

0 

12. 

Category  Flexibility 

92 

4 

100 

0 

0 

13. 

Induction 

84 

16 

0 

94 

0 

6 

14. 

Syllogistic  Reasoning 

84 

16 

0 

94 

6 

0 

15. 

Arithmetic  Reasoning 

72 

28 

0 

94 

6 

0 

1 6. 

Number  Facility 

72 

1 6 

12 

87 

13 

0 

17. 

Problem  Sensitivity 

68 

24 

8 

8l 

19 

0 

18. 

Flexibility  of  Closure 

64 

24 

12 

69 

31 

0 

19. 

Perceptual  Speed 

56 

24 

20 

63 

12 

25 

20. 

Spatial  Orientation 

40 

40 

20 

25 

63 

12 

21. 

Spatial  Scanning 

52 

40 

8 

50 

31 

19 

22. 

Visualization 

28 

52 

20 

50 

31 

19 

23. 

Auditory  Perceptual  Speed 

100 

■9 

0 

0 

0 

24. 

Auditory  Rhythm  Discrimination 

96 

Bfl 

0 

0 

0 

25. 

Arm-Hand  Steadiness 

12 

44 

44 

13 

37 

50 

26. 

Control  Precision 

l6 

24 

6o 

6 

44 

50 

27. 

Finger  Dexterity 

16 

28 

56 

MM 

37 

56 

28. 

Manual  Dexterity 

4 

44 

52 

Bfl 

69 

31 

29. 

Multilimb  Coordination 

36 

48 

16 

44 

44 

12 

30. 

Rate  Control 

68 

32 

0 

56 

37 

n 

31. 

Reaction  Time 

80 

20 

0 

69 

31 

32. 

Speed  of  Arm  Movement 

64 

24 

12 

44 

56 

II 

33. 

Response  Orientation 

60 

40 

0 

56 

44 

■a 

34. 

Wrist-Finger  Speed 

64 

28 

8 

44 

44 

12 

35. 

Verbal  Expression 

92 

8 

0 

100 

0 

0 

36. 

Attention 

36 

48 

16 

37 

37 

26 

37. 

Time  Sharing 

84 

12 

4 

75 

25 

0 

38. 

Explosive  Strength 

76 

1 6 

8 

87 

Y 

6 

39. 

Static  Strength 

48 

24 

28 

50 

44 

6 

40. 

Dynamic  Strength 

64 

24 

12 

63 

25 

12 

41. 

Extent  Flexibility 

96 

4 

0 

69 

31 

■1 

42. 

Dynamic  Flexibility 

88 

12 

0 

56 

37 

mm 

43. 

Cross  Body  Equilibrium 

92 

8 

0 

75 

25 

■1 

44. 

Cross  Body  Coordination 

84 

16 

0 

44 

50 

6 

45. 

Stamina 

92 

8 

0 

56 

44 

0 

46. 

Depth  Perception 

24 

48 

28 

18 

63 

19 

47. 

Color  Discrimination 

84 

12 

4 

94 

6 

48. 

Near  Visual  Acuity 

0 

48 

52 

13 

37 

49- 

Far  Visual  Acuity 

64 

36 

0 

50 

44 

50. 

Kinesthetic  Discrimination 

UL 

l6 

0 

13 
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TABLE  8 

Percentage  Distributions  of  the 
Ratings  Given  to  Task  4 
On  Each  of  the  Fifty  Abilities 


Percent  of  Judges  in  each  Rating  Category 


Verbal  Comprehension 
Assoclatlonal  Fluency 
Word  Fluency 
Serial  Recall 
Free  Recall 

Paired  Associate  Memory 

Memory  for  Operations 

Memory  for  Ideas 

Symbolic  and  Semantic  Ordering 

Ideational  Fluency 

Originality 

Category  Flexibility 

Induction 

Syllogistic  Reasoning 

Arithmetic  Reasoning 

Number  Paclllty 

Problem  Sensitivity 

Flexibility  of  Closure 

Perceptual  Speed 

Spatial  Orientation 

Spatial  Scanning 

Visualisation 

Auditory  Perceptual  Speed 

Auditory  Rhythm  Discrimination 

Arm -Hand  Steadiness 

Control  Precision 

Finger  Dexterity 

Manual  Dexterity 

Multi limb  Coordination 

Rate  Control 

Reaction  Time 

Speed  of  Arm  Movement 

Response  Orientation 

Wrist-Finger  Speed 

Verbal  Ixpresslon 

Attention 

Time  Sharing 

Explosive  Strength 

Static  Strength 

Dynamic  Strength 

Extent  Flexibility 

Dynamic  Flexibility 

Gross  Body  Equilibrium 

Gross  Body  Coordination 

Stamina 

Depth  Perception 
Color  Discrimination 
Near  Visual  Acuity 
Far  Visual  Acuity 
Kinesthetic  Discrimination 


AIR  JUDGES 


APA  JUDGES 


TABLE  9 


Percentage  Distributions  of  the 
Ratings  Given  to  Task  5 
On  Each  of  the  Fifty  Abilities 


ABILITY 

Percent 

of  Judges  in  Each  Rating  Category 

AIR  Judges 

APA  Judges 

Zero 

One 

Two 

Zero 

One 

Two 

1. 

Verbal  Comprehension 

76 

37 

44 

19 

2. 

Associational  Fluency 

4 

75 

25 

0 

3. 

Word  Fluency 

4 

81 

19 

0 

4. 

Serial  Recall 

40 

48 

44 

44 

12 

5. 

Free  Recall 

60 

40 

44 

50 

6 

6. 

Paired  Associate  Memory 

72 

24 

63 

25 

12 

7- 

Memory  for  Operations 

12 

24 

12 

25 

63 

8. 

Memory  for  Ideas 

44 

36 

37 

44 

19 

9. 

Symbolic  and  Semantic  Ordering 

36 

48 

16 

31 

44 

25 

10. 

Ideational  Fluency 

84 

16 

n 

81 

19 

0 

11. 

Originality 

72 

28 

■a 

100 

0 

0 

12. 

Category  Flexibility 

92 

8 

mm 

69 

31 

0 

13. 

Induction 

56 

40 

Bfl 

63 

25 

12 

14. 

Syllogistic  Reasoning 

72 

28 

1 

87 

7 

6 

15. 

Arithmetic  Reasoning 

56 

!  40 

1 

63 

19 

18 

16. 

Number  Facility 

56 

40 

KH 

63 

37 

0 

17. 

Problem  Sensitivity 

20 

40 

19 

37 

44 

18. 

Flexibility  cf  Closure 

8 

20 

72 

6 

19 

75 

19. 

Perceptual  Speed 

20 

12 

68 

6 

25 

69 

20. 

Spatial  Orientation 

4 

4 

92 

6 

19 

75 

21. 

Spatial  Scanning 

8 

16 

76 

0 

25 

75 

22. 

Visualization 

36 

36 

28 

6 

44 

50 

23. 

Auditory  Perceptual  Speed 

52 

48 

0 

37 

56 

7 

24. 

Auditory  Rhythm  Discrimination 

72 

24 

4 

50 

50 

0 

25. 

Arm-Hand  Steadiness 

16 

44 

40 

18 

19 

63 

2  e. 

Control  Precision 

12 

84 

0 

13 

87 

27. 

Finger  Dexterity 

48 

8 

50 

31 

19 

28. 

Manual  Dexterity 

48 

24 

19 

44 

37 

29. 

Multi  limb  Coordination 

16 

80 

6 

19 

75 

30. 

Rate  Control 

20 

16 

64 

6 

25 

69 

31. 

React  ion  Time 

24 

36 

40  ! 

6 

44 

50 

32. 

Speed  of  Arm  Movement 

44 

43 

8 

12 

69 

19 

33. 

Response  Orientation 

8 

32 

60 

6 

31 

63 

3'+. 

Wrist-Finger  Speed 

44 

56 

0 

50 

44 

6 

35. 

Verbal  Expression 

76 

24 

0 

69 

31 

0 

36. 

Attention 

16 

20 

64 

12 

25 

63 

37- 

Time  Sharing 

8 

24 

68 

12 

13 

75 

38. 

Explosive  Strength 

92 

8 

0 

81 

19 

0 

39. 

Static  Strength 

92 

8 

0 

69 

31 

0 

40. 

Dynamic  Strength 

64 

36 

0 

50 

31 

19 

41. 

Extent  Flexibility 

72 

28 

0 

50 

44 

6 

42. 

Dynamic  Flexibility 

64 

36 

0 

31 

50 

19 

43. 

Gross  Body  Equilibrium 

56 

32 

12 

31 

37 

32 

44. 

Oross  Body  Coordination 

64 

28 

8 

37 

37 

26 

45. 

Stamina 

80 

20 

0 

63 

25 

12 

46. 

Depth  Perception 

8 

16 

76 

0 

6 

94 

47. 

Color  Discrimination 

32 

40 

28 

19 

50 

3J 

48. 

Near  Visual  Acuity 

12 

48 

40 

13 

50 

37 

49. 

Far  Visual  Acuity 

0 

8 

92 

0  , 

19 

81 

50. 

Kinesthetic  Discrimination 

16 

48 

36 

25 

44 

31 

TABLE  10 

Percentage  Distributions  of  the 
Ratings  Given  to  Task  6 
On  Each  of  the  Fifty  Abilit’es 


ABILITY 

Percent 

of  Judges  in  Each  Rating  Category 

AIR  Judges 

j  APA  Judges 

Zero 

One 

Two 

Zero 

One 

Two 

1. 

Verbal  Conqprehensi on 

20 

64 

16 

25 

63 

12 

2. 

Associat ional  Fluency 

88 

8 

4 

81 

13 

6 

3. 

Word  Fluency 

88 

8 

4 

94 

6 

0 

4. 

Serial  Recall 

40 

36 

24 

19 

56 

25 

5. 

Free  Recall 

48 

36 

16 

56 

31 

13 

6. 

Paired  Associate  Memory 

36 

2U 

40 

37 

19 

44 

7- 

Memory  for  Operations 

32 

48 

20 

31 

56 

13 

8. 

Memory  for  Ideas 

68 

20 

12 

81 

19 

0 

9- 

Symbolic  and  Semantic  Ordering 

72 

24 

4 

69 

19 

12 

10. 

Ideational  Fluency 

84 

12 

4 

94 

6 

0 

11. 

Or  iginality 

92 

8 

0 

100 

0 

0 

12. 

Category  Flexibility 

88 

4 

8 

1  94 

6 

0 

13. 

Induction 

88 

4 

8 

94 

6 

0 

14. 

Syllogistic  Reasoning 

100 

0 

0 

100 

0 

0 

15. 

Arithmetic  Reasoning 

80 

20 

0 

100 

0 

0 

1 6. 

Humber  Facility 

56 

24 

20 

75 

25 

0 

17- 

Problem  Sensitivity 

80 

20 

0 

87 

13 

0 

18. 

Flexibility  of  Closure 

24 

0 

76 

25 

12 

63 

19- 

Perceptual  Speed 

16 

28 

56 

12 

13 

75 

20. 

Spatial  Orientation 

72 

24 

4 

69 

25 

6 

21. 

Spatial  Scanning 

60 

2  4 

16 

56 

25 

19 

22. 

Visual Izat Ion 

84 

12 

n 

56 

37 

7 

23. 

Auditory  Perceptual  Speed 

80 

12 

8 

87 

7 

6 

24. 

Auditory  Rhythm  Discrimination 

100 

0 

0 

87 

13 

0 

25. 

Arm-Hand  Steadiness 

68 

32 

0 

63 

37 

0 

26. 

Control  Precision 

88 

12 

0 

81 

19 

0 

27. 

Finger  Dexterity 

52 

32 

16 

44 

50 

6 

28. 

Manual  Dexterity 

84 

16 

0 

63 

37 

0 

29- 

Multi limb  Coordination 

100 

0 

0 

87 

13 

0 

30. 

Rate  Control 

84 

8 

8 

63 

31 

6 

31. 

Reaction  Time 

36 

40 

2  4 

19 

37 

44 

32. 

Speed  of  Arm  Movement 

64 

20 

16 

31 

56 

13 

33. 

Response  Oriental,  ion 

72 

12 

16 

44 

44 

12 

34. 

Wriut-Ftngcr  Speed 

76 

20 

4 

37 

50 

13 

34. 

VfM*bai  Expression 

88 

8 

‘l 

94 

6 

0 

36. 

Attention 

4 

0 

96 

6 

0 

94 

37. 

Time  Sharing 

64 

28 

8 

81 

13 

6 

38. 

Explosive  Strength 

100 

0 

0 

100 

0 

0 

39. 

Static  Strength 

100 

0 

0 

100 

0 

0 

40. 

Dynamic  Strength 

100 

0 

0 

94 

6 

0 

41. 

Extent  Flexibility 

100 

0 

0 

100 

0 

0 

42. 

Dynamic  Flexibility 

92 

8 

0 

100 

0 

0 

43. 

Oross  Body  Equilibrium 

100 

0 

0 

100 

0 

0 

44. 

Gross  Body  Coordination 

96 

4 

0 

100 

0 

0 

45- 

Stamina 

100 

0 

0 

100 

0 

0 

46. 

Depth  Perception 

88 

12 

0 

100 

0 

0 

47- 

Color  Discrimination 

92 

8 

0 

100 

0 

0 

48. 

Hear  Visual  Acuity 

4 

56 

40 

13 

56 

31 

49. 

Far  Visual  Acuity 

92 

4 

4 

87 

7 

6 

'50. 

Kinesthetic  Discrimination 

92 

8 

0 

94 

0 

6 

ji 

-26- 
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TABLE  11 


Number  of  Times  "Agreement"  Was  Achieved  on 
One  of  the  Three  Ratings  by  the  Two  Groups 
of  Judges  on  Each  of  the  Six  Tasks 


Task 


AIR  JUDGES 


Zero 


APA  JUDGES 


Zero 


TABLE  12 

Number  of  Significant  Positive  Relationships  Among  the  Judges  on 
the  Six  Tasks  and  the  Proportion  of  the  Total  Number  of 
Relationships  which  the  Positives  Constitute 


AIR  JUDGES 


OUTSIDE  JUDGES 


Task 

Number  of 
Positive  r  , 

_E  8 

Proportion 
of  Total 

Number  of 

Positive  r  , 
J£8 

Proportion 
of  Total 

1 

17 

.  06 

16 

.  13 

2 

36 

.  12 

16 

.  13 

3 

6 

.  02 

4 

.  03 

4 

28 

.  09 

8 

.  07 

5 

41 

.  14 

7 

.  06 

6 

16 

.  05 

9 

00 

© 

that  two  persons  or  profiles  fall  on  exactly  the  same  point  in  multi¬ 
dimensional  space.  An  r  value  of  0.  0  means  that  two  persons  fall 

_R 

as  far  apart  as  one  would  (on  the  average)  expect  for  any  two  points 

taken  at  random.  An  r  of  -1.  0  means  that  two  persons  are  on 

_£ 

opposite  ends  of  the  distribution  Examples  of  r  values  are  given 

_E 

in  Table  13.  The  ratings  shown  are  ratings  which  were  given  by 
three  pairs  of  AIR  judges  on  Task  2.  The  first  pair  represents  an 
revalue  of  zero.  The  second  pair  represents  a  significant  positive 
value  of  r^  (r^  ^  =  .  227),  and  the  third  pair  demonstrates  a  stronger, 

positive  relationship  between  profiles. 


Similarity  coefficients  were  also  calculated  between  the  mean 

ability  profiles  obtained  from  the  AIR  and  APA  judges  ratings  of  the 

tasks.  The  mean  profiles  were  developed  by  calculating  the  mean 

rating  given  by  each  group  of  judges  to  each  task  on  each  ability 

scale.  These  profiles  and  the  r  values  for  each  pair  are  shown  in 

— E 

Tables  14  and  15.  All  of  the  obtained  r  values  reveal  significant 

-R 

agreement  between  the  mean  ratings  of  the  AIR  and  APA  judges. 

Interview  data  with  respect  to  the  TAS  and  the  task  descriptions 
were  obtained  from  both  groups  of  judges.  They  will  not  be  presented 
here,  but  will  be  incorporated  when  appropriate  in  the  following 
section. 


Discussion  and  Conclusions 


The  pilot  study  provided  much  valuable  information  regarding  its 

primary  objectives.  In  general,  preliminary  reliability  data  were 

obtained,  the  r  statistic  was  shown  to  be  an  excellent  tool  for  assess- 

_£ 

ing  interprofile  similarity,  and  areas  of  change  and  improvement  in 
the  TAS  were  highlighted  both  by  the  data  and  the  judges'  comments. 


Similarity  Between  Mean  AbUity  Profiles  Given 
by  the  AIR  and  APA  Judges  on 
Task  1,  2 ,  and  3 


|  TASK  1  | 

TASK 

2 

TASK 

3 

rP  ‘ 

.87 

rP  “ 

.86 

rP  -  * 

87  ! 

AIR 

APA 

AIR 

APA 

AIR 

APA 

1. 

Verbal  Comprehension 

.64 

.69 

.80 

1.19 

.40 

.31 

2. 

Assoclational  Fluency 

.04 

.06 

.16 

.50 

0.00 

0.00 

3. 

Word  Fluency 

0.00 

.06 

.16 

.37 

0.00 

0.00 

4. 

Serial  Recall 

.20 

.13 

.72 

1.13 

.44 

.38 

5. 

Free  Recall 

.08 

.13 

.60 

.81 

.:6 

0.00 

6. 

Paired  Associate  Memory 

.20 

.13 

1.04 

.87 

.04 

0.00 

7. 

Memory  for  Operations 

.60 

•  5  6 

1.56 

1.62 

1.08 

1.19 

8. 

Memory  for  Ideas 

.28 

.44 

.36 

1.12 

.24 

.13 

9- 

Symbolic  and  Semantic  Order’ ng 

.24 

.13 

l .  08 

.81 

.20 

•  25 

10. 

Ideational  Fluency 

0.00 

.13 

.20 

.37 

0.00 

0.00 

11. 

Originality 

.04 

.06 

.31 

.04 

0.00 

12. 

Category  Flexibility 

0.00 

.13 

.16 

.37 

.12 

0.00 

13. 

Induction 

.12 

.13 

.56 

.63 

.16 

13 

14. 

Syllogistic  Reasoning 

0.00 

•  19 

.48 

.44 

.16 

.06 

15. 

Arithmetic  Reasoning 

.08 

.13 

1.24 

1.37 

.28 

.06 

l6. 

Number  Facility 

.08 

.13 

1.28 

1.69 

.40 

.13 

17. 

Problem  Sensitivity 

.44 

.13 

1.56 

1.44 

.40 

.19 

18. 

Flexibility  of  Closure 

.64 

.63 

1.36 

1.37 

.48 

•  31 

19- 

Perceptual  Speed 

.80 

•  94 

.84 

1.19 

.64 

.63 

20. 

Spatial  Orientation 

.72 

1.00 

1.52 

1.75 

•  80 

.87 

21. 

Spatial  Scanning 

.48 

.75 

1 . 36 

1.75 

.56 

.69 

22. 

Visualisation 

.64 

.69 

1.44 

1.81 

•  92 

.69 

23. 

Auditory  Perceptual  Speed 

.04 

.31 

.92 

.94 

0.00 

0.00 

24. 

Auditory  Rhythm  Discrimination 

0.00 

.25 

.12 

■  .37 

.04 

0.00 

25. 

Arm-Hand  Steadiness 

1.28 

1.8l 

.24 

.31 

1.32 

1.37 

26. 

Control  Precis' on 

l.?2 

1.8l 

.24 

.31 

1.44 

1.44 

27. 

Finger  Dexterity 

.72 

1.00 

.08 

.31 

1.40 

1.50 

28. 

Manual  Dexterity 

.76 

1.31 

.08 

.25 

1.48 

1.31 

29. 

Multilimb  Coordination 

.16 

.37 

0.00 

.25 

.80 

.69 

30. 

Rate  Control 

1.76 

2.00 

.16 

.81 

.32 

.50 

31. 

Reaction  Time 

1.08 

1.69 

.64 

1.06 

.20 

.31 

32. 

Speed  of  Arm  Movement 

•  92 

1.31 

.16 

.25 

.48 

.56 

33. 

Response  Orientation 

.68 

1.06 

.76 

1.44 

.40 

.44 

34. 

Wrist-Finger  Speed 

.60 

.87 

.08 

.25 

.44 

.6  9 

35. 

Verbal  Expression 

.04 

.06 

1.16 

1.37 

.08 

0.00 

3  6. 

Attent 1  on 

1.24 

1.44 

1 . 96 

1.75 

.80 

.87 

37. 

Time  Sharing 

.36 

•  37 

1.44 

1.44 

.20 

.25 

38. 

Explosive  Strength 

.04 

.13 

0.00 

.12 

.32 

.19 

39. 

Static  Strength 

.04 

.13 

0.00 

.19 

.80 

.56 

40. 

Dynamic  Strength 

.08 

.37 

0.00 

.25 

.48 

.50 

41. 

Extent  Flexibility 

.08 

.19 

0.00 

.19 

.04 

.31 

42. 

Dynamic  Flexibility 

.16 

.44 

0.00 

.19 

.12 

.50 

43. 

Gross  Body  Equilibrium 

.08 

.44 

0.00 

.19 

.08 

.25 

44. 

Gross  Body  Coord 'nation 

.04 

.44 

0.00 

.25 

.16 

.62 

45. 

Stamina 

0.00 

.31 

0.00 

.31 

.08 

.44 

46. 

Depth  Perception 

.64 

.75 

.48 

.44 

1.04 

1.00 

47. 

Color  Discrimination 

.76 

.31 

.32 

.19 

.20 

.06 

48. 

Near  Visual  Acuity 

]  .08 

1.00 

2.24 

1.13 

1.92 

1.37 

49. 

Far  Visual  Acuity 

.32 

.44 

.40 

.94 

.36 

.56 

50. 

Kinesthetic  Discrimination 

.12 

.31 

.16 

.19 

.16 

.25 

30 


TABLE  15 

Similarity  Between  Mean  Ability  Profiles  Given 
by  the  AIR  and  APA  Judges  on 
Task  4,  5,  and  6 


M  1 

1  TASK  5  1 

TASK  6  1 

ABILITY 

Bn 

rP  "  * 

91 

rP  = 

!8 

AIR 

APA 

AIR 

APA 

AIR 

APA 

1. 

Verbal  Comprehension 

.88 

1.13 

.84 

.81 

.81 

2. 

Assoc lational  Fluency 

.16 

.19 

.  12 

.2? 

.25 

3. 

Word  Fluency 

.08 

.06 

.04 

.19 

.16 

.06 

4. 

Serial  Recall 

.44 

.50 

.72 

.69 

.84 

1.06 

5. 

Free  Recall 

.32 

.37 

.40 

.63 

.68 

.56 

6. 

Paired  Associate  Memory 

.20 

.31 

.32 

•  50 

1.04 

1.06 

7- 

Memory  for  Operations 

1.64 

1.37 

1.44 

1.50 

.88 

.81 

8. 

Memory  for  Ideas 

.84 

1.13 

.76 

.81 

.44 

.19 

9- 

Symbolic  ana  Semantic  Ordering 

.72 

.94 

.80 

•  94 

.32 

.44 

10. 

Ideational  Fluency 

.24 

.19 

.  16 

.19 

.20 

.06 

11. 

Originality 

.36 

.19 

.28 

0.00 

.08 

0.00 

12. 

Category  Flexibility 

.12 

.13 

.08 

.31 

.20 

.06 

13. 

Induct  ion 

.80 

.50 

.48 

.50 

.20 

.06 

14. 

Syllogistic  Reasoning 

.76 

.69 

.28 

.19 

0.00 

0.00 

15. 

Arithmetic  Reasoning 

.92 

1.00 

.48 

.56 

.20 

0.00 

16. 

Number  Facility 

.56 

.75 

.48 

.37 

.64 

.25 

17. 

Problem  Sensitivity 

1.60 

1.00 

1.20 

1.25 

.20 

.13 

18. 

Flexibility  of  Closure 

.80 

1.06 

1.64 

1.69 

1.52 

1.37 

19. 

Perceptual  Speed 

.88 

1.06 

1.48 

1.63 

1.40 

1.63 

20. 

Spatial  Orientation 

1.52 

1.69 

1.88 

1.69 

.32 

.37 

21. 

Spatial  Scanning 

1.36 

1.56 

1.68 

1.75 

.56 

.63 

22. 

Visualization 

1.48 

1.81 

•  92 

1.44 

.20 

.50 

23. 

Auditory  Perceptual  Speed 

.16 

.25 

.48 

.69 

.28 

.19 

24. 

Auditory  Rhythm  Discrimination 

0.00 

.25 

.32 

•  50 

o.no 

.13 

25. 

Arm-Hand  Steadiness 

1.24 

1.44 

1.24 

1.44 

.32 

.37 

26. 

Control  Precision 

1.60 

1.88 

1.80 

1.88 

.12 

•  19 

27. 

Finger  Dexterity 

•  52 

.75 

.64 

.69 

.  64 

.63 

28. 

Manual  Dexterity 

.64 

.81 

.96 

1.19 

.16 

.37 

29. 

Multi  limb  Coordination 

.44 

.56 

1.76 

1.69 

0.00 

.13 

30. 

Rate  Control 

1.64 

1.75 

1.44 

1.65 

.24 

.44 

31. 

Reaction  Time 

1.00 

1.37 

1.16 

1.44 

.88 

1.25 

32. 

Speed  of  Arm  Movement 

.60 

.62 

.64 

1.06 

.52 

.81 

33. 

Response  Orientation 

1.32 

1.31 

1.52 

1.56 

.44 

.69 

34. 

Wrist-Finger  Speed 

.28 

.44 

.56 

.56 

.28 

•  75 

35- 

Verbal  Expression 

.16 

.19 

.24 

.31 

.16 

.06 

36. 

Attention 

1.16 

1.56 

1.48 

1.50 

1.92 

1.87 

37- 

Time  Sharing 

.84 

•63  . 

1.60 

1.63 

.44 

.25 

38. 

Explosive  Strength 

.08 

.25 

.08 

.19 

0.00 

0.00 

39. 

Static  Strength 

0.00 

.19 

.25 

CO  \o 
O  K\ 

.31 

0.00 

0.00 

40. 

Dynamic  Strength 

.04 

.69 

0.00 

.06 

41. 

Extent  Flexibility 

0.00 

•  25 

.28 

.56 

0.00 

0.00 

42. 

Dynamic  Flexibility 

0.00 

.31 

.36 

.87 

.08 

0.00 

43. 

Qross  Body  Equilibrium 

.12 

•  37 

.56 

1.00 

0.00 

0.00 

44. 

Qross  Body  Coordination 

.08 

.37 

.44 

.87 

.04 

0.00 

45. 

Stamina 

.04 

.31 

.20 

.50 

0.00 

0.00 

46. 

Depth  Perception 

.80 

.63 

1.68 

1.94 

.12 

0.00 

47. 

Color  Discrimination 

.04 

.25 

.96 

1.13 

.08 

0.00 

48. 

Near  Visual  Acuity 

1.24 

1.25 

1.28 

1.25 

1.36 

1.19 

49. 

Far  Visual  Acuity 

.52 

.63 

1.92 

1.81 

.12 

.19 

50. 

Kinesthetic  Discrimination 

.44 

.63 

1.20 

1.06 

.08 

.13 

-31- 


With  respect  to  the  reliability  of  the  individual  ability  scales, 
the  obtained  intraclass  correlation  coefficients  indicated  that  sub¬ 
stantial  reliability  can  be  expected  from  the  majority  of  the  TAS 
scales  if  they  are  employed  by  a  panel  of  judges.  The  coefficients 
obtained  for  the  reliability  of  a  single  judge  indicate  that  only  one 
of  the  ability  scales  (Control  Precision)  could  be  used  with  any 
reliability  by  a  single  judge.  The  discrepancy  among  the  r  ,  r  , 

and  r.  values  shown  in  Tables  3  and  4  indicates  that  the  within  task, 

Jk 

within  ability  error  variance  is  rather  large  and  that  it,  therefore, 
would  require  a  rather  large  panel  of  judges  (e.  g.  ,  n  =  25,  n  =  16)  to 
achieve  a  stable  estimate  of  the  rating  of  a  task  on  an  ability  scale. 
This  is  reflected  in  the  low  values  of  r  which  were  obtained  between 

-R 

pairs  of  individual  profiles.  The  low  values  indicate  substantial 
difference  in  interjudge  agreement  as  to  the  particular  abilities  and 
levels  of  abilities  which  account  for  performance  on  the  tasks. 

This  confirms  the  fact  that  a  large  pool  of  error  variance  exists  in 
the  judges'  ratings.  The  higher  values  of  r  obtained  for  the  com- 

— R 

parison  of  mean  profiles  between  groups  of  judges  (Tables  14  and 
15)  support  the  statement  made  above  with  respect  to  the  r  values. 

Iv 

That  is,  reliability  on  the  TAS  scales  is  possible,  but  for  this  re¬ 
liability  large  groups  of  judges  are  required  to  achieve  stable 
estimates  of  the  ratings. 

Although  the  data  do  not  indicate  the  causes  of  the  high  error 
variance,  the  comments  received  from  the  judges  suggest  two  possible 
sources  of  the  error  variance.  First,  probably  thf  most  pressing 
problem  which  was  uncovered  by  the  judges'  comments  involves  the 
criteria  for  applying  abilities  to  tasks.  In  the  instructions  given  in 
the  TAS,  the  judges  are  told  to  assign  a  task  rating  of  "one"  on  a 
given  ability  when  "the  average  person  would  exhibit  the  amount  of 
the  ability  required",  and  to  assign  a  rating  of  "two"  when  the  ability 
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is  required  at  an  above  base-line  level;  "that  is,  the  average  person 
would  not  exhibit  the  amount  of  the  ability  required.  "  This  criterion 
produces  difficulty  in  that  the  "average"  person  can  be  considered 
as  either  experienced  or  naive  on  a  given  task.  As  has  been  shown 
in  previous  factor -analytic  research  (Fleishman  &  Hempel,  1955), 
the  abilities  required  to  perform  a  task  change  with  respect  to  the 
amount  of  training  a  subject  has  on  the  task.  Thus,  the  "average 
person"  does  not  provide  a  stable  reference  criterion  for  assessing 
the  involvement  of  an  ability  in  a  task.  This  lack  of  a  stable  criterion 
which  can  be  equally  employed  by  all  of  the  judges  would  contribute 
heavily  to  differences  among  the  judges'  ratings  of  a  task.  To  meet 
this  problem,  the  concept  of  the  "average  person"  will  be  discarded 
in  future  research. 

A  second  possible  reason  of  the  error  variance  is  the  fact  that 
some  of  the  judges  found  it  possible  to  account  for  the  same  portion 
of  task  performance  by  means  of  two  different  ability  scales.  The 
possibility  of  utilizing  either  of  two  abilities  to  account  for  the  same 
aspect  of  performance,  could  cause  some  judges  to  choose  one  and 
some  judges  to  choose  the  other.  The  result  would  be  an  increase 
in  the  error  variance  associated  with  both  of  the  scales.  Thus, 
there  is  a  need  to  revise  the  TAS  so  as  to  carefully  mark  off  the 
limits  of  each  ability  and  to  provide  judges  with  the  specific  nature 
of  the  distinctions  between  abilities. 

The  investigation  of  the  data  by  means  of  intraclass  correlations 
was  followed  by  an  examination  of  the  distributions  which  underlay 
the  obtained  correlation  values.  The  distributions  are  presented  as 
percentages  in  Tables  5  through  10.  These  distributions  indicate 
that,  in  general,  where  reliability  or  "agreement"  was  obtained  it 
was  due  to  the  fact  that  the  judges  rated  the  ability  as  a  zero  (Table  10). 
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In  fact,  on  Ability  II  (Originality)  the  value,  r  =  1.  0,  is  due  to 

K. 

the  fact  that  on  Tasks  3,  5,  and  6  all  of  the  APA  judges  rated  the 
tasks  as  zerc  on  this  ability;  hence,  there  was  zero  variance  in  the 
ratings.  It  was  felt  that  the  predominance  of  the  zero  ratings  might 
be  due  to  the  fact  that  the  sample  of  tasks  employed  in  the  pilot  study 
did  not  cover  a  wide  enough  range  of  performance  to  require  the 
use  of  all  of  the  ability  scales. 

As  a  result  of  this  study,  two  other  points  were  brought  forth 
which  indicated  the  need  for  further  revision  of  the  TAS.  First, 
there  is  evidently  a  need  for  further  modification  of  the  list  of 
abilities  on  which  the  TAS  is  based.  Some  judges  commented  that 
there  were  elements  in  some  of  the  tasks  which  could  not  be  described 
in  terms  of  the  abilities  in  the  list.  Also,  in  light  of  other  comments 
which  were  received,  several  of  the  ability  definitions  appear  to 
warrant  revision,  with  particular  attention  being  given  to  the  inclusion 
of  more  and  better  examples.  Second,  the  use  of  only  three  rating 
categories  is  too  restrictive  both  from  an  interpretive  and  a  statistical 
point  of  view.  A  strong  need  for  a  more  sophisticated  scaling  tech¬ 
nique  was  indicated. 

In  summary,  this  pilot  study  provided  valuable  information  con¬ 
cerning  the  further  development  of  the  TAS.  As  a  result  of  this  study, 
it  was  decided  that  further  development  of  the  TAS  would  center 
around  the  following  areas; 

(1)  the  use  of  a  seven  point  rating  scale  to  improve  the 
quality  of  the  data; 

(2)  development  of  a  means  for  anchoring  the  ability  rating 

scales; 

(3)  modification  of  the  list  of  abilities  upon  which  the  TAS 
is  founded; 


(4)  redefinition  of  several  of  the  abilities  so  as  to  em¬ 
phasize  their  scope  and  limits  and  to  clearly  distinguish 
them  from  similar  abilities; 

(5)  the  development  of  stable  reference  criteria  for  applying 
ability  scales  to  tasks;  and 

(6)  a  change  in  the  format  for  presenting  the  TAS. 
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SECOND  PILOT  STUDY 


Before  the  second  pilot  study  could  be  initiated,  two  pre¬ 
paratory  efforts  had  to  be  completed.  First,  the  TAS  had  to  be 
modified  so  as  to  reduce  the  overlap  among  abilities  by  carefully 
specifying  the  distinctions  among  the  abilities  ?nd  so  as  to  reduce  any 
ambiguities  in  the  definitions  of  the  abilities.  Second,  the  scaling 
technique,  employed  in  the  previous  pilot  study,  had  to  be  revised  in 
order  to  provide  stable  anchors  for  the  scales,  and  to  improve  the 
metric  quality  of  the  rating  data. 

Modification  of  the  TAS 2 

The  50  abilities  from  the  version  of  the  TAS  used  in  the  first 
pilot  study  were  reorganized  into  a  set  of  37  abilities  for  the  second 
pilot  study  (Table  16).  This  reorganization  involved  the  elimination 
of  some  abilities,  the  condensation  of  some  sets  of  abilities  into 
smaller  sets,  or,  in  some  cases,  into  single  abilities,  and  the  re¬ 
definition  of  most  of  the  remaining  abilities. 

The  redefinition  of  the  abilities  was  intended  to  increase  inter¬ 
judge  reliability  in  the  use  of  the  TAS  by  reducing  ambiguity  in  the 
definitions  and  by  specifying  the  distinctions  among  abilities.  This 
was  accomplished  by  arranging  the  50  abilities  in  groups  according 
to  the  judged  similarity  among  them.  This  process  was  aided  by 
the  comments  concerning  the  definitions  made  by  the  judges  in  the 
first  pilot  study.  Within  each  of  the  groups,  the  definitions  were 
carefully  examined  to  determine  the  scope  of  the  behaviors  encom¬ 
passed  by  each  group.  The  range  of  behaviors  within  each  group  was 
then  partitioned  into  specifiably  distinct  categories  of  behavior  and 

2 

This  form  of  the  TAS  can  be  found  in  Appendix  C. 
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TABLE  16 


Reorganization  of  the  TAS  for  the 
Second  Pilot  Study 


TAS  from 

Second  Pilot  Study 

TAS  from 

First  Pilot  Study 

1. 

Verbal  Comprehension 

1. 

Verbal  Comprehension 

2. 

Associational  Fluency 

2. 

Verbal  Expression 

3. 

Word  Fluency 

3. 

Ideational  Fluency 

10. 

Ideational  Fluency 

4. 

Originality 

11. 

Originality 

35. 

Verbal  Expression 

4. 

Serial  Recall 

5. 

F ree  Recall 

5. 

Memorization 

6. 

Paired  Associate  Memory 

7. 

Memory  for  Operations 

8. 

Memory  for  Ideas 

6. 

Problem  Sensitivity 

9. 

Symbolic  and  Semantic  Ordering 

7. 

Mathematical  Reasoning 

12. 

Category  Flexibility 

9. 

Deductive  Reasoning 

13. 

Induction 

10. 

Inductive  Reasoning 

14. 

Syllogistic  Reasoning 

11. 

Information  Ordering 

15. 

Arithmetic  Reasoning 

12, 

Category  Flexibility 

17. 

Problem  Sensitivity 

8. 

Number  Facility 

16. 

Number  Facility 

13. 

Spatial  Orientation 

18. 

Flexibility  of  Closure 

14. 

Visualization 

20. 

Spatial  Orientation 

15. 

Speed  of  Closure 

21. 

Spatial  Scanning 

16. 

Flexibility  of  Closure 

22. 

Visualization 

17. 

Selective  Attention 

36. 

Attention 

18. 

Time  Sharing 

37. 

Time  Sharing 

19. 

Perceptual  Speed 

19. 

Perceptual  Speed 
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TABLE  16  Cont'd. 


TAS  from 

Second  Pilot  Study 

TAS  from 

First  Pilot  Study 

20. 

Static  Strength 

39. 

Static  Strength 

21. 

Explosive  Strength 

38. 

Explosive  Strength 

22. 

Dynamic  Strength 

40. 

Dynamic  Strength 

23. 

Stamina 

45. 

Stamina 

24. 

Extent  Flexibility 

41. 

Extent  Flexibility 

25. 

Dynamic  Flexibility 

42. 

Dynamic  Flexibility 

26. 

Gross  Body  Equilibrium 

43. 

Gross  Body  Equilibrium 

27. 

Choice  Reaction  Time 

31. 

Reaction  Time 

28. 

Reaction  Time 

32. 

Speed  of  Arm  Movement 

29. 

Speed  of  Limb  Movement 

33. 

Response  Orientation 

30. 

Wrist-Finger  Speed 

34. 

Wrist-Finger  Speed 

31. 

Gross  Body  Coordination 

27. 

Finger  Dexterity 

32. 

Multilimb  Coordination 

20. 

Manual  Dexterity 

33. 

Finger  Dexterity 

29. 

Multilimb  Coordination 

34. 

Manual  Dexterity 

44. 

Gross  Body  Coordination 

35. 

Arm-Hand  Steadiness 

25. 

Arm-Hand  Steadiness 

36. 

Rate  Control 

26. 

Control  Precision 

37. 

Control  Precision 

30. 

Rate  Control 

definitions  for  each  of  these  categories  were  then  developed. 


For  the  most  part,  this  redefinition  did  not  drastically  alter 
the  existing  definitions,  but  rather,  it  removed  terminology  from 
similar  or  related  definitions  which  might  have  served  as  a  source 
of  confusion  among  them.  In  the  case  of  the  abilities  of  Associational 
Fluency,  Word  Fluency,  Ideational  Fluency,  Originality,  and  Verbal 
Expression,  it  was  felt  that  the  range  of  behaviors  covered  by  these 
definitions  could  best  be  covered  by  a  set  of  three  definitions.  Thus, 
this  set  of  five  abilities  was  reorganized  into  a  set  of  three  (See 
Table  16)  which  still  covered  the  same  range  of  behaviors. 

The  area  of  memory  proved  to  be  particularly  difficult  to 
redefine.  Both  the  data  from  the  first  pilot  study  and  the  comments 
obtained  from  the  judges  indicated  that  the  existing  definitions  were 
inadequate  but  neither  of  these  sources  could  provide  a  basis  for  re¬ 
definition.  This  problem  was  compounded  by  the  fact  that  a  search 
of  the  literature  could  not  produce  a  definitive  factor-analytic  study 
which  could  guide  a  meaningful  division  of  this  area  into  separate 
categories.  Finally,  all  efforts  by  AIR  staff  members  to  produce 
definitions  of  subcategorics  of  memory  which  could  generally  be 
agreed  upon  ended  in  failure.  In  light  of  this,  it  was  decided  to  create 
a  single  memory  ability  which  would  emphasize  the  ability  to  memor¬ 
ize  new  information  in  a  task  setting  and  which  would  not  consider 
the  long-term  recall  of  previously  learned  material. 

Lastly,  the  sensory  abilities  were  not  included  in  the  version 
of  the  TAS  employed  in  the  second  pilot  study.  In  attempting  to  adequately 
cover  the  sensory  area,  it  quickly  became  apparent  that  a  major  effort 
would  be  needed  to  develop  a  comprehensive  set  of  descriptors  and  their 
attendant  definitions.  Thus,  a  decision  was  made  to  eliminate  these  concepts 
from  the  TAS  with  the  understanding  that,  if  the  results  of  the  second 
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pilot  study  warranted  further  development  of  the  TAS,  the  effort 
would  be  made  to  develop  ability  definitions  in  the  sensory  area. 
This  decision  was  based  upon  the  judgment  that  it  was  better,  at 
that  time,  to  obtain  an  immediate  further  estimate  of  the  feasibility 
of  utilizing  ability  scales  in  task  classification  than  it  was  to  be¬ 
come  diverted  into  an  effort  to  organize  the  sensory  area. 

In  the  above  mentioned  process  of  grouping  and  defining 
abilities,  many  distinctions  among  the  ability  definitions  became 
apparent  and  were  made  explicit.  In  order  to  enhance  the  judges' 
comprehension  of  each  ability  definition  and  tol  reduce  confusion 
among  the  definitions,  it  was  decided  to  formally  incorporate 
these  distinctions  into  the  TAS.  Thus,  in  the  version  of  the  TAS 
employed  in  the  second  pilot  study,  these  distinctions  are  listed 
below  each  of  the  ability  definitions.  It  was  hoped  that  they  would 
enhance  the  reliability  of  the  TAS. 

Revision  of  the  Scaling  Techniques 

In  the  first  pilot  study  the  judges  rated  the  tasks  on  what 
was  essentially  a  three  point  scale.  In  the  second  pilot  study 
this  was  changed  to  a  seven  point  scale  and  a  new  technique 
was  employed  to  better  anchor  the  scales.  This  anchoring 
technique  was  adopted  from  Smith  and  Kendall  (1963).  As  it 
was  employed  in  the  present  study,  this  technique  utilized 
as  scale  anchors  both  definitions  of  the  high  and  low  ends  of 
the  scale  and  examples  of  tasks  which,  in  an  independent  study, 
were  rated  as  high,  moderate,  and  low  on  each  of  the  scales. 

The  development  of  these  anchors  required  a  special  study 
consisting  of  three  separate  steps. 
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Development  of  definition  anchors.  First,  professional  staff 
members  of  AIR,  who  were  familiar  with  the  abilities  approach 
to  task  classification,  were  asked  to  develop  definitions  of  the 
high  and  low  ends  of  each  of  the  37  ability  scales.  This  was  an 
iterative  process  involving  careful  examination  of  the  definition 
of  each  ability  and  development  of  definitions  of  high  and  low 
amounts  of  each  ability.  The  process  was  terminated  for  a 
given  ability  scale  when  general  agreement  could  be  reached  on 
the  definitions  of  both  the  high  and  low  ends  of  the  scale.  Examples 
of  these  definitions  can  be  seen  in  the  scales  in  Appendix  C. 

Generation  of  examples.  Two  panels,  one  consisting  of  AIR 
staff  professionals  and  the  other  of  students  from  an  area  univer¬ 
sity,  were  assembled  to  generate  examples  of  tasks  which  would 
reflect  high,  moderate  and  low  levels  of  each  of  the  37  abilities. 

The  procedure  for  each  individual  was  to  take  each  ability  defi¬ 
nition  in  turn  and  generate  examples  of  every  day  occupational  or 
laboratory  tasks  thought  to  require  the  ability.  Since  the  TAS  was 
intended  for  use  with  judges  who  might  be  drawn  from  any  of  the 
behavioral  or  engineering  sciences,  both  of  the  panels  were  in¬ 
structed  to  generate  examples  which  would  be  familiar  to  almost 
any  judge  who  might  possibly  use  the  TAS.  Approximately  1000 
examples  were  developed  in  this  manner. 

Scaling  of  the  examples.  Once  the  examples  had  been  gene¬ 
rated,  those  examples  which  would  be  the  most  stable  anchors 
had  to  be  selected  and,  in  order  to  place  the  examples  at  approp¬ 
riate  points  along  the  ability  scales,  the  scale  values  of  the  examples 
had  to  be  established.  To  a.chieve  these  objectives,  the  following 
procedure  was  employed.  Eighteen  graduate  students  from  an  area 
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university  were  asked  to  rate  each  of  the  examples  on  the  particular 
ability  scale  it  was  intended  to  reflect.  These  judges  also  were 
permitted  the  option  of  rejecting  any  example  as  not  being  representative 
of  the  scale  on  which  it  was  to  be  rated.  From  these  ratings,  means 
and  standard  deviations  for  each  example  were  obtained. 

Three  examples,  one  with  a  high  scale  value,  one  with  a  moderate 

scale  value  and  one  with  a  low  scale  value,  were  chosen  to  anchor 

each  scale.  To  select  the  three  examples  for  each  scale,  the  mean 

ratings  of  all  of  the  examples  rated  upon  a  particular  scale  were 

examined  and  grouped  as  being  high,  moderate,  or  low.  Within 

each  of  these  groups,  that  example  with  the  smallest  standard 

deviation  was  chosen  to  anchor  the  scale.  This  was  the  example 

about  which  there  was  most  agreement  among  the  judges  on  the 

amount  of  the  ability  required  for  that  example.  An  effort  was  made 

to  select  examples  with  standard  deviations  of  less  than  1.  0.  However, 

in  some  instances  this  was  not  possible.  The  means  and  standard 

deviations  of  the  examples,  which  were  utilized  n  the  TAS  (see 

3 

Appendix  C),  are  shown  in  Table  17  . 

As  can  be  seen  in  Table  17,  for  some  scales  it  was  possible  to 
obtain  a  greater  spread  between  the  high,  moderate,  and  low  exam¬ 
ples  than  for  other  scales.  However,  considerable  discrimination 
between  examples  was  achieved  along  with  considerable  agreement 
within  examples.  Considering  their  one  standard  deviation  values 
and  their  positions  on  the  ability  scales,  there  was  virtually  no 
overlap  among  the  three  examples  on  each  ability  scale. 

3 

Although  they  are  not  presented  in  this  report,  the  means  and 
standard  deviations  for  all  of  the  examples,  both  those  which  were 
used  and  those  which  were  rejected,  are  available. 
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TABLE  17 

Means  and  Standard  Deviations  of  the  High,  Average  and  Low 
Examples  Used  as  Scale  Anchors^ 


See  Appendix  C  for  the  actual  statement  of  the  high,  moderate  and  low  examples 


used  on  each  of  the  37  ability  scales. 


The  next  phase  of  the  second  pilot  study  was  intended  to  deter¬ 
mine  the  reliability  of  the  revised  version  of  the  TAS  and  to 
uetermine  whether  the  example  anchors  enhanced  scale  reliability. 

Since  it  was  hoped  that  the  ability-based  task  classification 

system  would  be  employed  in  later  phases  of  the  project  by  judges 

who  might  not  be  psychologists,  the  judges  employed  in  this  study 

were  graduate  students  from  an  area  university.  Two  groups  of 

these  judges  were  obtained.  Group  1  (n  =  19)  was  asked  to  rate  a 

set  of  tasks  on  ability  scales  which  were  anchored  both  with  definitions 

of  high  and  low  and  with  examples.  Group  2  (n  =  22)  was  given  the 

identical  rating  task  but  their  ability  scales  were  anchored  only  with 

5 

the  definitions  of  high  and  low.  This  experimental  procedure  was 
employed  to  determine  the  contribution  of  example  anchors  to 
scale  reliability. 

The  rating  instructions  given  to  both  groups  of  judges  are  shown 
in  Appendix  C.  In  general,  the  judges  were  instructed  to  follow  a 
two  stage  rating  procedure.  First,  they  had  to  decide  whether  an 
ability  was  required  for  the  performance  of  the  task.  If  their  decision 
was  "no"  (a  rating  of  "zero"),  they  would  proceed  to  the  next  ability 
scale.  If  their  decision  was  "yes"  they  proceeded  to  the  second  step 
where  they  rated  the  task  on  a  seven-point  rating  scale.  In  making 
these  ratings,  the  judges  were  told  to  estimate  the  lowest  amount  of 
an  ability  which  a  subject  could  possess  and  still  produce  errorless 
performance  on  the  task. 

5 

The  version  of  the  TAS,  shown  in  Appendix  C  is  that  used  by  Group  1. 
The  form  used  by  Group  2  was  different  only  in  that  the  examples 
used  as  scale  anchors  were  not  present. 
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A  set  of  six  task  descriptions  were  chosen  for  this  pilot  study. 
These  tasks  are  listed  in  Table  18  and  the  complete  task  descriptions 
can  be  found  in  Appendix  C.  Four  of  these  task  descriptions  (Air 
traffic  controller,  Sheet  metal  worker,  Astronaut,  Helicopter  Pilot) 
were  the  same  as  those  used  in  the  first  pilot  study.  The  remaining 
two  task  descriptions  (Automobile  driving,  Basketball  game)  were 
developed  so  as  to  be  familiar  to  the  judges  who  were  rating  the  tasks. 
This  was  done  to  determine  whether  the  judges  would  be  more 
reliable  in  rating  tasks  with  which  they  were  familiar. 


TABLE  18 

List  of  Task  Descriptions  Used  in  Second  Pilot  Study 


Number 

Task 

1. 

Automobile  driving 

2. 

Air  traffic  controller 

3. 

Sheet  metal  worker 

4. 

Astronaut 

5. 

Helicopter  pilot 

6. 

Basketball  game 

To  determine  whether  these  task  descriptions  were  truely 
more  familiar  to  the  judges,  the  judges  were  asked  to  rate  each  of 
the  six  task  descriptions  on  a  set  of  six  rating  scales  (see  Appendix 
C).  These  seven-point  scales  measured  the  following  aspects  of 
the  judges'  familiarity  with  the  task  descriptions:  1)  degree  of 
understanding,  2)  completeness  of  task  description,  3)  clarity  of 
task  description,  4)  degree  of  familiarity,  5)  degree  of  experience, 
and  6)  degree  of  proficiency. 
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Analysis  and  Results 


The  analysis  of  the  data  from  the  second  pilot  study  essentially 
paralleled  that  from  the  first  pilot  study.  To  determine  interjudge 
reliability,  intraclass  correlation  coefficients  were  calculated  and 
the  percentage  distributions  of  the  judges'  ratings  were  examined; 
similarity  coefficients  were  used  to  determine  similarity  between 
pairs  of  task  ability  profiles. 

The  intraclass  correlation  data  are  shown  in  Table  19.  These 
data  indicate  that  substantial  reliability  was  achieved  (r^)  using  a 
large  panel  of  judges  (19  or  22),  but  that  little  reliability  can  be 
expected  if  the  TAS  is  to  be  employed  by  a  single  judge  (r^).  How¬ 
ever,  for  small  groups  of  judges  (r^)  about  half  of  the  scales  (53% 
for  Group  1  and  50%  for  G^oup  2)  show  reliability  estimates  greater 
than  0.  70.  While  these  would  not  be  acceptable  in  a  final  version 
of  the  TAS,  they  should  be  considered  acceptable  for  a  pilot  studv. 

The  intraclass  correlations  were  also  examined  with  respect  to 
the  use  of  examples  as  scale  anchors.  This  investigation  revealed 
that  Group  1  was  no  different  from  Group  2  and,  therefore,  that  no 
enhancement  of  scale  reliability  could  be  attributed  to  the  use  of  the 
examples.  Thus,  the  improvement  which  was  noted  from  the  final 
study  to  the  second  must  be  attributed  to  the  improved  ability  defi¬ 
nitions,  better  defined  scales  and  more  detailed  rating  instructions. 

Just  as  in  the  first  pilot  study,  the  percentage  distributions  of 
the  judges'  ratings  were  examined  to  gain  some  insight  into  the 
nature  of  the  intraclass  correlations.  These  distributions  are  shown 
in  Tables  20  to  25.  In  addition,  the  means  and  standard  deviations 
of  the  frequency  distributions  from  which  these  percentage  distri¬ 
butions  were  calculated  arc  shown  in  Tables  26  to  31. 


t 


TABLE  19 

Average  (r,  ),  Group  (r  ),  and  Individual  (r  )  Reliabilities 
— k  5  1 

for  Both  Groups  of  Judges 


Ability- 

Verbal  Comprehension 
Verbal  Expression 
Ideational  Fluency- 
Originality 
Memorization 
Problem  Sensitivity 
Mathematical  Reasoning 
Number  Facility 
Deductive  Reasoning 
Inductive  Reasoning 
Information  Ordering 
Category  Flexibility 
Spatial  Orientation* 
Visualization  j 
Speed  of  Closure  J 
Flexibility  of  Closure 
Selective  Attention 
Time  Sharing  J 
Perceptual  Spec <f 
Static  Strength 
Explosive  Strength 
Dynamic  Strength 
Stamina  i! 

Extent  Flexibility 
Dynamic  Flexibility 
Gross  Body  Equilibrium 
Choice  Reaction  Time 
Reaction  Tirne 
Speed  of  Lirno  Movement 
Wrist  Finger  Speed 
Gross  Body/Equilibrium 
Multilimb  Coordination 
Finger  DeJ^erity 
Manual  Dekterity 
Arm-Hancf  Steadiness 
Rate  Control 
Control  Precision 


GROUP  1 

GROUP  2 

r 

r  „ 

r . 

r 

r 

r 

— k 

-5 

-i 

-k 

% 

-i 

.  95 

.  83 

.49 

.  94 

.77 

.40 

.91 

.  73 

.  35 

.  95 

.  80 

.  45 

.  60 

.29 

.  08 

.  71 

.35 

.  10 

♦ 

o 

00 

.  36 

.10 

.  81 

.  50 

.  17 

.  81 

.  53 

.19 

.  90 

.  67 

.  28 

.  85 

.  60 

.  23 

.  90 

.  67 

.  29 

.  98 

.  94 

.  75 

.  97 

.  89 

.  61 

.  97 

.  90 

.  65 

.  97 

.  89 

.  63 

.  68 

.  36 

.10 

.  85 

.  56 

.  20 

.  72 

.40 

.  12 

.  87 

.  50 

.  17 

.  94 

.  81 

.45 

.  92 

.71 

.  33 

.72 

.40 

.  12 

.  73 

.  38 

.  11 

.  96 

.85 

.53 

.  92 

.72 

.  34 

.  94 

.  80 

.45 

.  88 

.61 

.24 

.  74 

.43 

.  13 

.  65 

.  30 

.  08 

.  83 

.57 

.21 

.  82 

.52 

.  18 

.  53 

.  23 

.  06 

.  72 

.  37 

.  11 

.  93 

.78 

.42 

.  93 

.74 

.  36 

.  87 

.  65 

.27 

.89 

.66 

.  28 

.  63 

.  31 

.  08 

.  80 

.48 

.  16 

.  96 

.86 

.  56 

.  07 

.90 

.  63 

.  97 

.  90 

.  64 

.  07 

.  89 

.  62 

.  96 

.  87 

.  57 

.  97 

.  89 

.62 

.  96 

.85 

.  53 

.97 

.  88 

.  60 

.  93 

.78 

.42 

.  97 

.87 

.  57 

.  93 

.  77 

.40 

.  95 

.80 

.45 

.  92 

.75 

.  37 

.  94 

.77 

.40 

.  92 

.75 

.  38 

.  93 

.75 

.  37 

.  93 

.  77 

.41 

.  96 

.  83 

.  50 

.  89 

.  68 

.  30 

.  89 

.  65 

.  27 

.  95 

.  84 

.52 

.  96 

.  84 

.  52 

.  84 

.59 

.22 

.  93 

.75 

.  38 

.  77 

.47 

.  15 

.  84 

.  54 

.  19 

.  83 

.  57 

.21 

.  87 

.  59 

.23 

.  79 

.50 

.16 

.  89 

.  64 

.26 

.87 

.64 

.26 

.  81 

.49 

.  16 

.  93 

.79 

.43 

.79 

.44 

.  14 
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TABLE  20 


( 


Percentage  Distributions  of  the  Ratings  Given  to 
Task  1  on  Each  of  the  Thirty-Seven  Abilities 


Ability 

Group 

Rating 

0 

1 

2 

3 

4 

5 

6 

7 

1.  Verbal  Comprehension 

63 

21 

5 

11 

0 

0 

0 

0 

41 

32 

9 

5 

8 

5 

0 

0 

2.  Verbal  Expression 

95 

0 

0 

0 

0 

0 

5 

0 

77 

13 

0 

0 

0 

5 

5 

0 

3.  Ideational  Fluency 

53 

16 

5 

11 

5 

5 

5 

0 

2 

50 

5 

9 

10 

13 

13 

0 

0 

4.  Originality 

1 

37 

21 

11 

21 

0 

5 

0 

5 

2 

31 

9 

18 

18 

13 

5 

0 

5 

5.  Memorization 

53 

0 

21 

0 

16 

10 

0 

0 

22 

18 

18 

9 

23 

10 

0 

0 

6.  Problem  Sensitivity 

5 

16 

11 

16 

26 

11 

5 

11 

2 

0 

9 

9 

22 

27 

9 

18 

5 

7,  Mathematical  Reasoning 

1 

79 

5 

16 

0 

0 

0 

0 

0 

2 

77 

5 

9 

5 

4 

0 

0 

0 

8.  Number  Facility 

79 

11 

5 

0 

0 

5 

0 

0 

72 

13 

9 

0 

0 

6 

0 

0 

9*  Deductive  Reasoning 

10 

11 

31 

16 

11 

16 

0 

5 

2 

9 

31 

13 

9 

18 

9 

5 

6 

10.  Inductive  Reasoning 

53 

21 

5 

0 

5 

0 

11 

5 

36 

31 

0 

9 

9 

5 

5 

5 

11.  Information  Ordering 

21 

26 

15 

27 

0 

0 

5 

5 

6 

18 

13 

13 

31 

5 

5 

9 

12.  Category  Flexibility 

84 

0 

0 

11 

5 

0 

0 

0 

2 

36 

9 

22 

13 

9 

5 

6 

0 

13.  Spatial  Orientation 

1 

11 

21 

21 

26 

21 

0 

0 

0 

2 

0 

5 

9 

13 

22 

13 

27 

10 

14.  Visualization 

1 

31 

11 

21 

26 

0 

5 

0 

6 

2 

22 

9 

6 

10 

lS 

9 

13 

13 

15.  Speed  of  Closure 

1 

42 

0 

26 

21 

5 

0 

0 

6 

2 

18 

9 

5 

13 

13 

18 

18 

6 

16.  Flexibility  of  Closure 

36 

5 

15 

15 

11 

0 

11 

6 

13 

5 

9 

9 

27 

18 

9 

10 

17.  Selective  Attention 

0 

11 

21 

11 

11 

21 

4 

21 

5 

0 

5 

5 

18 

36 

27 

4 

18.  Time  Sharing 

11 

21 

15 

21 

15 

11 

0 

6 

18 

9 

9 

13 

5 

36 

5 

5 

19.  Perceptual  Speed 

15 

11 

31 

11 

ll 

11 

0 

10 

0 

0 

14 

6 

27 

22 

13 

18 

20.  Static  Strength 

21 

47 

15 

5 

6 

0 

0 

6 

2 

22 

32 

13 

9 

9 

9 

0 

6 

21.  Explosive  Strength 

1 

31 

?6 

11 

21 

5 

6 

0 

0 

2 

40 

27 

5 

9 

9 

5 

0 

9 

22.  Dynamic  Strength 

1 

68 

11 

15 

6 

0 

0 

0 

0 

2 

31 

0 

5 

0 

0 

5 

0 

23.  Stamina 

1 

42 

42 

5 

5 

6 

0 

0 

0 

2 

50 

27 

13 

5 

0 

0 

5 

0 

24.  Extent  Flexibility 

1 

5 

42 

2  6 

21 

0 

0 

0 

6 

2 

9 

54 

18 

5 

14 

0 

0 

0 

i 
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TABLE  20cont»d. 


Ability 

Group 

3 

S 

2  * 

Rating 

3  4 

25.  Dynamic  Flexibility 

1 

21 

11 

21 

15 

11 

2 

13 

27 

9 

9 

27 

26.  Gross  Body  Equilibrium 

1 

52 

21 

11 

0 

5 

2 

45 

22 

5 

13 

9 

27.  Choice  Reaction  Time 

1 

0 

0 

11 

5 

42 

2 

6 

0 

9 

13 

22 

20.  Reaction  Time 

1 

0 

0 

6 

26 

36 

2 

0 

0 

0 

22 

9 

29.  Speed  of  Limb  Movement 

1 

0 

0 

15 

47 

6 

2 

9 

5 

0 

13 

22 

JO.  Wrist  Finger  Speed 

6 

15 

31 

21 

15 

0 

9 

9 

5 

22 

31.  Gross  Body  Equilibrium 

47 

21 

15 

6 

11 

27 

9 

6 

18 

22 

32.  Multilimb  Coordination 

0 

15 

6 

15 

36 

2 

0 

9 

18 

0 

27 

33.  Flngor  Dexterity 

mm 

26 

31 

31 

11 

0 

B 

13 

18 

22 

27 

5 

34.  Manual  Dexterity 

B 

5 

26 

21 

15 

21 

■B 

9 

9 

9 

18 

22 

35«  Arm-Hand  Steadiness 

1 

15 

21 

15 

21 

11 

2 

22 

18 

9 

5 

22 

36.  Rate  Control 

1 

15 

11 

5 

11 

26 

2 

13 

5 

5 

13 

18 

37.  Control  Precision 

1 

0 

11 

11 

31 

26 

■ _ 

2 

5 

5 

18 

5 

36 

Percentage  Distributions  of  the  Rating  Given  to 
Task  2  on  Each  of  Thirty-Seven  Abilities 


1. 


3. 


4. 


5. 


6. 


7- 


8. 


9- 


10. 


11. 


12. 


13. 


14. 


15- 


1 6. 


17- 


18. 


19- 


20. 


21. 


22. 

23. 


24. 


Ability 


0  roup 


Rating 


-1 


0 


Verbal  Comprehension 

5 

0 

Verbal  Expression 

5 

0 

Ideational  Fluency 

1 

36 

2 

28 

Originality 

1 

42 

2 

18 

Memorization 

1 

52 

2 

0 

Problem  Sensitivity 

1 

5 

2 

0 

Mathematical  Reasoning 

1 

0 

2 

0 

Number  Facility 

1 

5 

2 

0 

Deductive  Reasoning 

1 

6 

2 

9 

Inductive  Reasoning 

1 

22 

2 

18 

Information  Ordering 

0 

5 

Category  Flexibility 

36 

2 

32 

Spatial  Orientation 

1 

11 

2 

10 

Visualization 

1 

5 

2 

9 

Speed  of  Closure 

57 

13 

Flexibility  of  Closure 

36 

2 

9 

Selective  Attention 

1 

36 

2 

6 

Time  Sharing 

6 

14 

Perceptual  Speed 

11 

0 

Static  Strength 

1 

89 

2 

82 

Explosive  Strength 

B4 

36 

Dynamic  Strength 

1 

78 

2 

>5 

Stamina 

1 

78 

2 

68 

Extent  Flexibility 

! 

63 

77 

1 

2 

3 

4 

5 

6 

7 

5 

12 

0 

26 

15 

15 

22 

4 

13 

5 

18 

5 

13 

40 

5 

15 

15 

22 

6 

l6 

16 

5 

5 

0 

18 

5 

27 

40 

l6 

6 

6 

5 

21 

5 

5 

9 

0 

9 

22 

13 

13 

5 

11 

0 

15 

0 

11 

21 

0 

9 

5 

5 

22 

5 

22 

13 

0 

21  . 

0 

15 

12 

0 

0 

13 

6 

9 

22 

5 

40 

5 

15 

ll 

15 

26 

11 

5 

12  , 

13 

6 

9 

9 

13 

32 

18 

0 

0 

5 

21 

47 

11 

16 

9 

13 

0 

13 

23 

32 

10 

0 

0 

0 

32 

15 

43 

5 

9 

0 

13 

6 

13 

36 

23 

0 

0 

22 

48 

7 

17 

0 

18 

6 

9 

13 

18 

18 

9 

5 

22 

5 

15 

5 

15 

11 

9 

22 

13 

9 

14 

6 

9 

0 

0 

15 

52 

11 

ll 

11 

0 

5 

9 

18 

9 

31 

23 

5 

12 

5 

11 

ll 

15 

5 

5 

5 

9 

U 

18 

9 

9 

0 

0 

5 

21 

47 

ll 

5 

6 

13 

9 

9 

0 

13 

40 

0 

5 

11 

26 

15 

22 

16 

5 

5 

5 

9 

9 

0 

0 

0 

0 

27 

l6 

0 

8 

4 

13 

18 

5 

18 

21 

0 

5 

11 

5 

21 

ll 

11 

5 

5 

18 

22 

5 

18 

18 

15 

11 

0 

11 

12 

15 

0 

0 

9 

18 

13 

9 

18 

27 

0 

0 

l6 

0 

36 

36 

* 

0 

0 

0 

18 

9 

18 

13 

28 

5 

0 

0 

ll 

31 

21 

21 

5 

9 

0 

23 

9 

31 

23 

0 

0 

5 

0 

0 

0 

6 

13 

5 

0 

0 

0 

0 

0 

11 

0 

0 

0 

5 

0 

0 

9 

5 

0 

0 

0 

0 

0 

12 

5 

5 

0 

0 

0 

0 

0 

5 

0 

0 

0 

0 

0 

16 

0 

0 

0 

0 

6 

0 

5 

5 

5 

12 

5 

0 

0 

15 

5 

12 

5 

0 

0 

0 

9 

9 

0 

0 

5 

0 

0 

Ability 


TABLE  21  Con»t. 


Group 


Rating 


Dynamic  Flexibility 


Gross  Body  Equilibrium 


Choice  Reaction  Time 


Reaction  Time 


Speed  of  Limb  Movement 


Wrist  Finger  Speed 


Gross  Body  Equilibrium 


Multilimb  Coordination 


Finger  Dexterity 


Manual  Dexterity 


Arft-Hand  Steadiness 


Rate  Control 


Control  Precision 


73 

5 

5  • 

0 

12 

5 

0 

0 

77 

5 

13 

0 

5 

0 

0 

0 

85 

5 

0 

5 

0 

0 

5 

0 

86 

0 

0 

0 

5 

0 

9 

0 

11 

0 

5 

5 

15 

31 

21 

11 

13 

6 

0 

13 

23 

9 

27 

9 

12 

5 

5 

11 

15 

21 

26 

5 

13 

0 

9 

14 

14 

9 

23 

18 

57 

11 

5 

11 

5 

11 

0 

0 

63 

9 

0 

5 

9 

5 

9 

0 

57 

11 

li 

0 

11 

5 

5 

0 

45 

9 

5 

9 

18 

5 

4 

4 

84 

11 

0 

0 

0 

5 

0 

0 

76 

5 

5 

0 

0 

0 

9 

5 

76 

5 

5 

0 

12 

C 

0 

0 

50 

13 

0 

9 

0 

14 

0 

14 

57 

11 

22 

0 

5 

0 

5 

0 

26 

18 

18 

13 

9 

3 

9 

0 

47 

11 

22 

15 

0 

5 

0 

0 

40 

13 

18 

5 

5 

0 

5 

14 

63 

15 

11 

0 

0 

5 

5 

0 

50 

13 

12 

5 

5 

4 

0 

9 

68 

5 

0 

0 

5 

12 

5 

5 

40 

0 

0 

5 

9 

5 

27 

14 

36 

5 

5 

0 

5 

27 

16 

6 

13 

5 

13 

0 

4 

22 

13 

30 

TABLE  22 

Percentage  Distributions  of  the  Rating  Given  to 
Task:  3  on  Each  of  Thirty-Seven  Abilities 


Ability 

Group 

Rating 

0 

1 

2 

3 

4 

1. 

Verbal  Comprehension 

1 

73 

22 

5 

0 

0 

2 

64 

9 

9 

9 

9 

2. 

Verbal  Expression 

1 

73 

22 

0 

5 

0 

2 

77 

9 

5 

0 

9 

3, 

Ideational  Fluency 

1 

68 

11 

21 

0 

0 

2 

59 

18 

9 

9 

5 

4, 

Originality 

1 

73 

22 

5 

0 

0 

2 

42 

41 

18 

0 

0 

5. 

Memox*J  zat  ion 

1 

36 

22 

15 

0 

15 

2 

'*7 

18 

22 

9 

13 

6. 

Problem  Sensitivity 

] 

5 

31 

42 

16 

6 

2 

13 

31 

31 

9 

5 

7. 

Mathematical  Reasoning 

1 

68 

5 

22 

0 

0 

2 

45 

22 

10 

18 

5 

8. 

Number  Facility 

1 

68 

15 

5 

6 

0 

2 

51 

27 

9 

13 

0 

9- 

Deductive  Reasoning 

1 

15 

31 

36 

6 

6 

2 

13 

41 

28 

13 

0 

10. 

Inductive  Reasoning 

1 

47 

36 

12 

0 

0 

2 

32 

30 

27 

0 

5 

11. 

Information  Ordering 

1 

21 

11 

42 

15 

a 

s 

2 

0 

32 

23 

9 

22 

12. 

Category  Flexibility 

1 

57 

22 

15 

0 

0 

2 

45 

27 

13 

9 

6 

13. 

Spatial  Orientation 

1 

47 

21 

32 

0 

0 

2 

27 

27 

18 

5 

13 

14. 

Visualizat ion 

1 

26 

42 

11 

5 

11 

2 

18 

18 

27 

0 

18 

15. 

Speed  of  Closure 

1 

68 

15 

12 

0 

5 

2 

36 

13 

13 

22 

6 

16. 

Flexibility  of  Closure 

1 

26 

52 

11 

11 

0 

2 

36 

36 

5 

18 

0 

17. 

Selective  Attention 

1 

26 

15 

31 

11 

12 

2 

9 

18 

18 

9 

27 

18. 

Time  Sharing 

1 

68 

22 

5 

0 

0 

2 

68 

9 

13 

5 

0 

19. 

Perceptual  Speed 

1 

5 

57 

15 

12 

13. 

2 

13 

32 

22 

13 

9 

20. 

Static  Strength 

1 

12 

31 

21 

0 

26 

2 

27 

13 

18 

5 

32 

21. 

Explosive  Strength 

1 

15 

21 

11 

31 

15 

2 

45 

18 

9 

9 

5 

22. 

Dynamic  Strength 

1 

36 

21 

15 

11 

12 

2 

68 

5 

13 

9 

5 

23. 

Stamina 

1 

36 

32 

12 

5 

0 

2 

40 

27 

5 

9 

9 

24. 

Extent  Flexibility 

1 

0 

52 

11 

11 

21 

2 

27 

40 

9 

18 

5 

-53- 
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000 
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TABLE  22  Con*d. 


Ability 

Group 

Rating 

0 

1 

2 

3 

4 

5 

6 

7 

25.  Dynamic  Flexibility 

21 

21 

26 

15 

5 

5 

5 

0 

15 

50 

0 

9 

18 

5 

5 

0 

26.  Gross  Body  Equilibrium 

57 

26 

12 

0 

5 

0 

0 

0 

63 

22 

9 

6 

0 

c 

0 

0 

27*  Choice  Reaction  Time 

32 

36 

0 

5 

27 

0 

0 

0 

2 

45 

18 

22 

5 

5 

5 

cr 

0 

28.  Reaction  Time 

1 

26 

42 

11 

5 

15 

0 

0 

0 

2 

22 

32 

27 

0 

19 

0 

0 

0 

29.  Speed  of  Limb  Movement 

1 

22 

31 

21 

21 

0 

5 

0 

0 

22 

18 

18 

9 

22 

0 

5 

6 

30,  Wrist  Finger  Speed 

11 

15 

42 

11 

11 

10 

0 

0 

0 

ro 

VjJ 

18 

23 

14 

13 

9 

0 

31.  Gross  Body  Equilibrium 

32 

31 

26 

0 

11 

0 

0 

0 

2 

45 

13 

18 

13 

9 

0 

0 

0 

32*  Multilimb  Coordination 

5 

22 

31 

5 

32 

5 

0 

0 

18 

22 

13 

9 

18 

9 

5 

6 

33.  Finger  Dexterity 

5 

5 

26 

26 

26 

5 

5 

0 

5 

9 

18 

18 

18 

6 

10 

18 

34*  Manual  ifoxterKy 

12 

15 

26 

15 

15 

12 

5 

0 

5 

13 

13 

18 

5 

9 

14 

23 

35.  Arm-Hand  Steadiness 

11 

11 

11 

21 

26 

15 

0 

5 

2 

5 

23 

9 

6 

13 

l> 

13 

18 

36.  Rate  Control 

73 

5 

0 

C 

5 

12 

5 

0 

40 

0 

0 

5 

9 

5 

21 

14 

37*  Control  Precision 

15 

12 

21 

21 

21 

5 

0 

5 

2 

9 

18 

6 

10 

9 

22 

13 

13 

TABLE  23 

Percentage  Distribution  of  the  Rat'ng  Given  to 


Task  4  on  Each  f  Thirty-Seven  Abilities 


Ability 

Group 

Pating 

0 

1 

2 

3 

4 

5 

6 

7 

1.  Verbal  Comprehension 

1 

42 

0 

0 

0 

11 

15 

16 

16 

2 

3  c 

9 

R 

0 

13 

9 

9 

23 

2.  Verbal  Expression 

1 

92 

0 

0 

0 

5 

15 

12 

16 

2 

41 

0 

9 

0 

18 

0 

9 

23 

3.  Ideational  Fluency 

1 

47 

0 

0 

11 

15 

5 

6 

16 

2 

36 

9 

0 

0 

22 

10 

10 

13 

4.  Originality 

1 

47 

0 

5 

0 

19 

15 

12 

6 

2 

18 

9 

5 

5 

22 

■  6 

23 

14 

5 .  Memorization 

3. 

22 

0 

6 

6 

12 

22 

26 

11 

•"> 

5 

6 

9 

9 

9 

18 

31 

13 

6.  Problem  Sensitivity 

1 

11 

0 

il 

5 

11 

5 

42 

15 

2 

0 

9 

5 

5 

18 

5 

22 

36 

7.  Mathematical  Reasoning 

1 

0 

0 

0 

5 

5 

15 

47 

26 

2 

0 

5 

0 

5 

5 

22 

13 

50 

8,  Humber  Facility 

1 

5 

0 

5 

0 

5 

21 

26 

36 

2 

9 

0 

5 

5 

5 

13 

13 

50 

9.  Deductive  Reasoning 

1 

22 

5 

5 

0 

26 

15 

15 

12 

2 

9 

5 

5 

5 

5 

22 

27 

18 

10.  Inductive  Reasoning 

1 

32 

5 

5 

0 

21 

21 

5 

11 

2 

13 

13 

9 

5 

22 

10 

14 

14 

11.  Information  Ordering 

1 

5 

0 

0 

6 

6 

3  6 

15 

32 

2 

0 

0 

0 

5 

13 

5 

36 

41 

12.  Category  Flexibility 

1 

B7 

0 

0 

11 

11 

0 

0 

21 

2 

18 

18 

9 

5 

13 

13 

14 

10 

13.  Spatial  Orientation 

1 

11 

0 

0 

0 

0 

0 

32 

42 

2 

5 

5 

0 

5 

5 

5 

30 

45 

14.  Visualization 

1  ! 

6 

0 

0 

6 

0 

16 

36 

36 

2 

0 

0 

0 

0 

5 

22 

27 

46 

15.  Speed  of  Closure 

1 

31 

5 

0 

0 

15 

11 

15 

21 

2 

32 

0 

9 

5 

5 

0 

18 

31 

16.  Flexibility  of  Closure 

1 

36 

0 

0 

5 

11 

12 

21 

15 

2 

13 

6 

5 

9 

9 

18 

27 

13 

17.  Selective  Attont'on 

1 

47 

5 

0 

5 

:i 

12 

5 

15 

2 

27 

9 

9 

5 

5 

9 

22 

14 

18,  Time  Charing 

1 

1  1 

5 

15 

5 

11 

47 

2 

5 

0 

0 

c 

13 

18 

40 

18 

19.  Perceptual  Speed 

1 

10 

0 

11 

0 

5 

ll 

42 

21 

2 

13 

0 

0 

0 

9 

10 

40 

28 

20.  Static  Strength 

1 

36 

26 

26 

6 

0 

0 

6 

1 

2 

63 

28 

0 

0 

0 

0 

0 

9 

21.  Explosivo  Strength 

1 

57 

37 

6 

0 

0 

0 

0 

0 

2 

62 

18 

5 

5 

5 

0 

0 

0 

22.  Dynamic  Strength 

1 

68 

22 

0 

5 

5 

0 

0 

0 

2 

72 

28 

0 

0 

0 

0 

0 

0 

2,3.  Stamina 

1 

53 

15 

0 

6 

6 

0 

5 

5 

2 

+9 

18 

IB 

9 

5 

0 

0 

r> 

24.  Extent  Flexibility 

1 

26 

42 

27 

0 

'j 

0 

0 

0 

90 

9 

13 

s 

!  .5 

5 

5 

0 

-55- 


TABLE  24 

Percentage  Distributions  of  the  Rating  Given 
To  Task  5  °n  Each  of  Thirty-Seven  Abilities 


( 


Ability 

Group 

Rating 

0 

1 

2 

3 

4 

5 

6 

7 

1.  Verbal  Comprehension 

1 

5 

6 

16 

15 

26 

22 

5 

5 

2 

9 

13 

0 

28 

13 

9 

28 

0 

2.  Verbal  Expression 

1 

26 

5 

15 

11 

26 

5 

0 

12 

2 

31 

18 

13 

5 

9 

18 

5 

0 

3.  Ideational  Fluency 

1 

47 

15 

0 

5 

11 

11 

0 

11 

2 

28 

5 

18 

13 

18 

9 

9 

0 

4.  Originality 

1 

32 

n 

15 

11 

15 

11 

0 

5 

2 

32 

5 

5 

9 

9 

13 

27 

0 

5.  Memorization 

1 

15 

15 

5 

5 

15 

21 

12 

11 

2 

5 

0 

9 

5 

27 

9 

27 

18 

6.  Problem  Sensitivity 

1 

0 

5 

15 

22 

5 

15 

16 

22 

2 

0 

6 

5 

9 

9 

13 

?1 

27 

7-  Mathematical  Reasoning 

1 

36 

5 

12 

5 

15 

5 

16 

6 

2 

32 

9 

13 

0 

13 

18 

9 

6 

8,  Humber  Facility 

1 

42 

3 

5 

15 

12 

11 

5 

5 

2 

45 

5 

9 

5 

9 

27 

0 

0 

9.  Deductive  Reasoning 

1 

15 

5 

11 

22 

22 

15 

5 

5 

2 

5 

9 

9 

5 

2'r 

9 

2? 

9 

10.  Inductive  Reasoning 

1 

36 

0 

0 

21 

15 

11 

12 

5 

2 

13 

9 

9 

13 

18 

13 

19 

6 

:  11.  Information  Ordering 

1 

12 

0 

21 

15 

21 

15 

11 

5 

2 

5 

0 

5 

18 

22 

5 

36 

9 

12.  Category  Flexibility 

1 

42 

.i 

5 

11 

11 

15 

0 

11 

2  1 

32 

0 

13 

9 

13 

13 

14 

6 

13.  Spatial  Orientation 

1 

11 

0 

0 

0 

0 

15 

31 

42 

2 

5 

0 

0 

c 

5 

9 

27 

54 

14.  Visualization 

1 

32 

0 

21 

21 

5 

11 

5 

b 

2 

10 

0 

5 

5 

9 

is 

13 

40 

15.  Speed  of  Closure 

1 

36 

10 

0 

11 

21 

11 

11 

0 

2 

13 

6 

5 

9 

9 

18 

27 

13 

16.  Flexibility  of  Closure 

1 

11 

0 

0 

5 

22 

15 

31 

l6 

2 

13 

6 

0 

13 

13 

9 

18 

28 

17,  Selective  Attention 

1 

25 

5 

0 

15 

22 

5 

lb 

12 

2 

0 

0 

3 

9 

23 

23 

22 

18 

18.  Time  Sharing 

1 

n 

0 

5 

11 

25 

11 

31 

5 

2 

6 

0 

13 

13 

18 

23 

13 

14 

19.  Perceptual  Speed 

1 

5 

0 

11 

26 

11 

15 

26 

5 

2 

5 

3 

0 

9 

22 

5 

36 

18 

20.  Static  Strength 

1 

26 

26 

31 

5 

0 

0 

0 

12 

2 

22 

10 

31 

13 

5 

5 

9 

b 

21.  Explosive  Strength 

1 

52 

15 

15 

12 

0 

0 

0 

6 

2 

59 

9 

14 

0 

9 

0 

9 

0 

22.  Dynamic  Strength 

1 

36 

32 

22 

0 

5 

0 

0 

b 

2 

28 

28 

13 

13 

13 

5 

0 

0 

23.  Stamina 

1 

21 

42 

21 

5 

11 

0 

0 

0 

* 

36 

14 

9 

9 

27 

0 

0 

b 

24.  Extent  Flexibility 

1 

12 

31 

42 

15 

0 

0 

0 

0 

2 

-_21_ 

_LL_ 

1? 

_ 

14 _ 

6 

0 

-57- 


TABLE  24  Con'd. 


Ability 

Croup 

0 

1 

2 

Rating 

3  4 

5 

25.  Dynamic  Flexibility 

1 

2o 

11 

26 

11 

11 

2 

23 

5 

27 

0 

13 

5 

26,  Oross  Body  Equilibrium 

1 

33 

27 

5 

5 

0 

5 

2 

31 

9 

5 

13 

18 

9 

27.  Choice  Reaction  Time 

1 

0 

0 

0 

26 

16 

16 

2 

10 

0 

6 

14 

13 

22 

23,  Reaction  Time 

1 

5 

5 

11 

21 

21 

15 

2 

0 

0 

6 

13 

18 

22 

29*  Speed  of  Limb  Movement 

1 

10 

21 

11 

5 

26 

11 

2 

0 

10 

5 

9 

27 

18 

30,  Wrist  Finger  Speed 

1 

22 

12 

15 

11 

15 

5 

2 

0 

13 

i>~ 

y 

.  18 

18 

22 

31*  Oross  Body  Equilibrium 

1 

43 

26 

15 

5 

11 

0 

2 

10 

13 

10 

10 

22 

13 

32  jiL'DitV  4  Coordination 

1 

1C 

26 

0 

5 

26 

21 

2 

0 

6 

0 

9 

23 

22 

33..  Finger  Dexterity 

1 

47 

21 

0 

u 

0 

21 

mm 

14 

5 

18 

27 

18 

0 

34.  Manual  Dexterity 

WM 

2  6 

11 

5 

15 

12 

13 

i  6 

0 

9 

18 

22 

3 

35.  Arm-Hand  Steadiness 

1 

26 

0 

11 

15 

11 

11 

9 

0 

14 

9 

23 

3 

36.  Rate  Control 

15 

15 

0 

0 

5 

31 

14 

0 

6 

5 

13 

9 

37.  Control  Precision 

5 

0 

5 

0 

26 

42 

2 

0 

6 

0 

6 

13 

13 

TJBLE  25 

Percentage  Distributions  of  the  Hating  Given  to 
Task  6  on  Each  of  Thirty-Seven  Abilities 


1.  Verbal  Comprehension 

2.  Verbal  Expression 

3.  Ideational  Fluency 

4.  Originality 

5.  Memorization 

6.  Problem  Sensitivity 

7.  Mathematical  Reasoning 

8.  Number  Facility 

9.  Deductive  Reasoning 

10.  Inductive  Reasoning 

11.  Information  Ordering 

12.  Category  Flexibility 

13.  Spatial  Orientation 

14.  Visualization 

15.  Speed  of  Closure 

16.  Flexibility  of  Closure 

17.  Selective  Attention 

18.  Time  Sharing 

19.  Perceptual  Speed 

20.  Static  Strength 

21.  Explosive  Strength 

22.  Dynamic  Strength 
23*  Stamina 

24.  Extent  Flexibility 


Rating 

0 

1 

2 

3 

4 

5 

6 

7 

47 

11 

31 

11 

0 

0 

0 

0 

36 

40 

9 

5 

0 

5 

5 

0 

47 

6 

26 

21 

0 

0  " 

0 

0 

36 

30 

5 

5 

9 

5 

9 

0 

63 

5 

5 

11 

5 

11 

0 

0 

36 

9 

5 

6 

9 

13 

13 

9 

31 

5 

11 

11 

26 

0 

5 

11 

22 

0 

10 

14 

14 

18 

9 

13 

42 

5 

0 

15 

26 

0 

11 

0 

13 

18 

5 

23 

18 

9 

14 

0 

16 

0 

26 

26 

15 

12 

5 

0 

5 

10 

9 

27 

22 

9 

22 

0 

73 

16 

6 

5 

0 

0 

0 

0 

68 

18 

0 

0 

9 

0 

5 

0 

68 

16 

16 

C 

0 

0 

0 

0 

68 

22 

5 

0 

0 

0 

5 

0 

15 

0 

36 

22 

12 

5 

5 

9 

9 

18 

18 

1? 

>  22 

0 

14 

6 

31 

21 

11 

21 

11 

0 

0 

5 

36 

13 

18 

9 

9 

9 

0 

31 

12 

42 

5 

5 

5 

0 

0 

22 

18 

9 

9 

13 

9 

14 

6 

52 

15 

15 

6 

6 

6 

0 

0 

45 

9 

13 

5 

13 

5 

9 

0 

15 

15 

26 

12 

12 

15 

0 

5 

9 

5 

0 

9 

9 

5 

36 

27 

21 

11 

26 

21 

11 

5 

5 

0 

18 

6 

5 

9 

22 

5 

22 

13 

52 

11 

11 

5 

11 

0 

5 

5 

18 

9 

5 

5 

5 

27 

18 

13 

12 

11 

11 

15 

5 

36 

5 

5 

22 

5 

9 

13 

13 

18 

14 

6 

31 

0 

5 

11 

15 

11 

15 

12 

5 

0 

5 

9 

18 

5 

40 

18 

15 

0 

0 

32 

22 

11 

5 

15 

18 

0 

14 

6 

9 

13 

27 

13 

22 

0 

0 

31 

21 

15 

0 

11 

5 

0 

5 

5 

18 

9 

45 

13 

11 

% 

21 

5 

11 

5 

0 

11 

40 

0 

18 

5 

5 

5 

18 

9 

0 

0 

0 

22 

31 

21 

11 

15 

0 

0 

0 

5 

5 

5  ‘ 

31 

54 

5 

0 

0 

0 

11 

42 

11 

31 

13 

5 

0 

6 

9 

5 

22 

40 

0 

0 

0 

0 

32 

6 

26 

36 

0 

0 

0 

5 

0 

0 

32 

63 

5 

0 

0 

0 

32 

36 

5 

22 

0 

5 

0 

6 

9 

13 

36 

31 

r 


Group 


25. 

26. 

27. 

28. 

29. 

30. 

31. 

32. 

33. 


34. 

35. 

36. 


Ability 

Dynamic  Flexibility 
Cross  Body  Equilibrium 
Choice  Reaction  Time 
Reaction  Time 
Speed  of  Limb  Movement 
Wrist  Finger  Speed 


1 

2 

1 

2 

1 

2 

1 

2 

1 

2 


Oross  Body  Equilibrium 
Mvltilimb  Coordination 
Finger  Dexterity 
Manual  Dexterity 
Arm -Hand  Steadiness 
Rate  Control 


2 

1 

2 

1 

2 

1 

2 

1 

2 

1 

2 

1 

2 

1 


Rating 


- 

1 

2 

•  3 

4 

0 

0 

0 

5 

l6 

0 

0 

0 

5 

0 

0 

5 

5 

15 

22 

0 

5 

5 

0 

9 

0 

0 

0 

11 

31 

0 

0 

0 

5 

5 

0 

0 

0 

c 

s 

22 

5 

0 

5 

0 

0 

0 

0 

0 

0 

26 

0 

0 

0 

9 

0 

0 

0 

0 

11 

11 

6 

0 

5 

0 

18 

0 

0 

0 

6 

26 

0 

0 

0 

c 

5 

21 

0 

5 

11 

26 

0 

0 

0 

* 

0 

18 

12 

0 

31 

21 

11 

0 

6 

5 

5 

27 

0 

0 

0 

0 

5S 

0 

0 

0 

6 

18 

12 

0 

5 

5 

36 

0 

0 

0 

9 

22 

12 

0 

5 

5 

26 

22 

0 

9 

5 

5 

36 

12 

11 

15 

15 

41 

0 

0 

9 

18 

37*  Control  Precision 


2 


TABLE  26 

Means  and  Standard  Deviations  for  Each  of  the 
Thirty -Seven  Ability  Scales  on  Task  1 
for  Both  Groups  of  Judges 


Ability 

Group  1 

Group  2 

Mean  S.D. 

Mean  S.  D. 

1.  Verbal  Comprehension 

0.  63  0.  98 

1.28  1.44 

2.  Verbal  Expression 

0.32  1.34 

0.70  1.57 

3.  Ideational  Fluency 

1.37  1.87 

1.80  1.92 

4.  Originality 

1.68  1.89 

2.2?  1.78 

5.  Memorization 

1.58  1.87 

2.3C  1.57 

6.  Problem  Sensitivity 

3,47  1.96 

4.05  1.26 

7.  Mathematical  Reasoning 

0.  37  0.  74 

0.57  1.12 

8.  Number  Facility 

0.47  1.19 

0.57  1.16 

9.  Deductive  Reasoning 

2.79  1.79 

2.77  1.77 

10.  Inductive  Reasoning 

1.53  2.  30 

1.86  2.05 

11.  Information  Ordering 

2.05  1.88 

3.35  1.75 

12.  Category  Flexibility 

0.53  1.23 

1.87  1.73 

13.  Spatial  Orientation 

2.26  1.29 

4.63  1.26 

14.  Visualization 

1.94  1.85 

3.  52  2. 36 

15.  Speed  of  Closure 

1.74  1.83 

3.53  2.15 

16.  Flexibility  of  Closure 

2.  26  2.  24 

3.85  1.75 

17.  Selective  Attention 

4.11  2.05 

4.  88  0.  94 

18.  Time  Sharing 

2.68  1.81 

3.45  1.87 

19.  Perceptual  Speed 

1 

2.  74  2.  07 

4.89  1.00 

20.  Static  Strength 

1.53  1.63 

2.11  1.81 

21.  Explosive  Strength 

1.58  1.50 

1.76  1.74 

22.  Dynamic  Strength 

0.  58  0.  94 

0.98  1.22 

23.  Stamina 

0.89  1.07 

1.22  1.19 

24.  Extent  Flexibility 

1.95  1.47 

1.82  0.79 

25.  Dynamic  Flexibility 

2.58  1.98 

2.94  1.64 

26.  Gross  Body  Equilibrium 

1.21  1.79 

1.53  1.39 

27.  Choice  Reaction  Time 

4.58  1.50 

4.83  1.16 

28.  Reaction  Time 

4.42  1, 57 

5.  39  0.  68 

29.  Speed  of  Limb  Movement 

3.89  1.65 

4.66  1.40 

30.  Wrist  Finger  Speed 

2.68  1.59 

4.62  0.67 

31.  Gross  Body  Equilibrium 

1.11  1.33 

2.88  1.70 

32.  Multilimb  Coordination 

3.79  1.73 

4.50  1.54 

33.  Finger  Dexterity 

1.26  0.96 

2.65  1.71 

34.  Manual  Dexterity 

2.58  1.57 

3.76  1.48 

35.  Arm-Hand  Steadiness 

2.  58  2.  03 

2.93  1.94 

36.  Rate  Control 

3.37  2.  08 

4.26  1.88 

37.  Control  Precision 

3.58  1.60 

4.06  1.69 
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Means  and  Standard  Deviations  for  Each  of  the 
Thirty-Seven  Ability  Scales  on  Task  2 
for  Doth  Groups  of  Judges 


Ability 

Group  1 

Group  2 

Mean  S.D. 

Mean  S.D. 

1.  Verbal  Comprehension 

4.36  1.97 

5.15  1.88  . 

2.  Verbal  Expression 

4.  02  2.  04 

5.62  1.61 

3.  Ideational  Fluency 

2.44  2. 36 

3.17  2.26 

4.  Originality 

2.46  2.41 

2.56  2.  51 

5.  Memorization 

3.87  1.19 

4.51  1.60 

6.  Problem  Sensitivity 

4.29  1.04 

4.91  1.52 

7.  Mathematical  Reasoning 

5.12  0.99 

4.62  1.77 

8.  Number  Facility 

4.97  1.44 

5.16  1.76 

9.  Deductive  Reasoning 

3.88  1.22 

3.85  2.  04 

10.  Inductive  Reasoning 

3.29  2.31 

2.  99  2.  08 

11.  Information  Ordering 

4.  58  0.  73 

5.20  1.35 

12.  Category  Flexibility 

2.71  2.50 

3.13  2.40 

13.  Spatial  Orientation 

4.49  1.41 

4.  85  2.  09 

14.  Visualization 

4.73  1.52 

5.11  1.93 

15.  Speed  of  Closure 

2.  35  2.  61 

4.25  2.  20 

16.  Flexibility  of  Closure 

3.17  2.50 

4.36  1.79 

17.  Selective  Attention 

2.48  2.13 

4.95  1.38 

18.  Time  Sharing 

5.04  1.10 

4.70  1.97 

19.  Perceptual  Speed 

4.93  1.82 

5.31  0.85 

20.  Static  Strength 

0.61  1.66 

0.  32  0.  54 

21.  Explosive  Strength 

0.45  1.14 

0.26  0.53 

22.  Dynamic  Strength 

0.40  *'.82 

0.  14  0.  47 

23.  Stamina 

0.52  1.36 

1.10  1.67 

24.  Extent  Flexibility 

0.90  1.20 

0.58  1.13 

25.  Dynamic  Flexibility 

0.98  1.55 

0.63  1.00 

26.  Gross  Body  Equilibrium 

0.60  1.47 

0.80  1.86 

27.  Choice  Reaction  Time 

4.71  1.30 

4.31  1.71 

28.  Reaction  Time 

4.34  1.52 

4.47  1.78 

29.  Speed  of  Limb  M u  'ement 

1.47  1.63 

1.58  1.99 

30.  Wrist  Finger  Speed 

1.46  1.84 

2.  21  2.  04 

31.  Gross  Body  Equilibrium 

0.43  1.14 

1.13  2.13 

32.  Multilimb  Coordination 

0.78  1.20 

2.48  2.  67 

33.  Finger  Dexterity 

1.12  1.58 

2.21  1.79 

34.  Manual  Dexterity 

1.40  1.35 

2.  22  2.  34 

35.  Arm-Hand  Steadiness 

1.08  1.65 

1.72  2.13 

36.  Rate  Control 

1.  65  2.  32 

3.51  2.69 

37.  Control  Precision 

3.19  2.42 

4.  59  2.20  1 

4 


TABLE  28 


Means  and  Standard  Deviations  for  Each  of  the  Thirty-Seven  Ability 
Scales  on  Task  3  for  both  Groups  of  Judges 


1 

Group  1 

Group  2 

Ability 

Mean  S.  D. 

Mean  S.  D. 

1.  Verbal  Comprehension 

0.  56  0.  46 

1.14  1.23 

2.  Verbal  Expression 

0.  58  0.  67 

0.80  1.08 

3.  Ideational  Fluency 

0.  65  0.  80 

0.96  1.13 

4.  Originality 

0.45  0.  59 

0.  89  0.68 

5.  Memorization 

1.89  1.58 

2.21  1.63 

6.  Problem  Sensitivity 

2.  07  0.  21 

2.22  1.46 

7.  Mathematical  Reasoning 

1.01  1.12 

1.35  1.11 

8.  Number  Facility 

1.05  1.55 

1.10  0.86 

9.  Deductive  Reasoning 

1.89  0.96 

1.86  1.26 

10.  Inductive  Reasoning 

1.02  1.09 

1.23  0.88 

11.  Information  Ordering 

2.19  1.09 

2.92  1.07 

12.  Category  Flexibility 

0.93  1.19 

1.14  1.08 

13.  Spatial  Orientation 

1.08  0.62 

2.  04  1.  52 

14.  Visualization 

1.72  1.19 

2.78  1.79 

15.  Speed  of  Closure 

0.70  1.03 

2.01  1.67 

16.  Flexibility  of  Closure 

1.22  0.73 

1.43  1.17 

17.  Selective  Attention 

2.03  1.63 

3.22  1.55 

18.  Time  Sharing 

0.84  1.04 

0.99  1.34 

19.  Perceptual  Speed 

1.90  0.60 

2.29  1.22 

20.  Static  Strength 

2.40  1.70 

2.15  1.70 

21.  Explosive  Strength 

2.34  1.58 

1.56  1.90 

22.  Dynamic  Strength 

1.60  1.69 

0.78  1.25 

23.  Stamina 

1.66  2.08 

1.55  1.78 

24.  Extent  Flexibility 

2.26  1.46 

1.34  1.17 

2b.  Dynamic  Flexibility 

2.05  1.62 

2.03  1.71 

26.  Gross  Body  Equilibrium 

0.72  1.05 

0.  58  0.  86 

27.  Choice  Reaction  Time 

1.83  1.34 

1.38  1.24 

28.  Reaction  Time 

1.65  1.10 

1.79  1.09 

29.  Speed  cf  Limb  Movement 

1.71  1.24 

2.39  i .  90 

30.  Wrist  Finger  Speed 

2.34  1.31 

3.15  1.44 

31.  Gross  Body  Equilibrium 

1.29  1.21 

1.32  1.37 

32.  Multilimb  Coordination 

2.57  1.34 

2.66  1.92 

33.  Finger  Dexterity 

3.06  1.27 

3.87  1.94 

34.  Manual  Dexterity 

2.71  1.56 

4.10  2.16 

35.  Arm-Hand  Steadiness 

3.21  1.71 

3.  94  2.23 

36.  Rate  Control 

1.19  2.03 

1.48  1.67 

37.  Control  Precision 

2.80  1.55 

4.03  1.95 
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TABLE  29 


Means  and  Standard  Deviations  for  Each  of  the  Thirty-Seven  Ability 
Scales  on  Task  4  for  both  Groups  of  Judges 


TABLE  30 


Means  and  Standard  Deviations  for  Each  of  the  Thirty-Seven  Ability 
Scales  on  Task  5  for  Both  Groups  of  Judges 


Ability 

Group  1 

Group  2 

Mean 

S.D. 

Mean 

S.D. 

1.  Verbal  Comprehension 

3.  80 

1. 31 

3.74 

1.  73 

2.  Verbal  Expression 

2.  88 

2.  04 

2.28 

1. 93 

3.  Ideational  Fluency 

2.  14 

2.  28 

2.  63 

1.  84 

4.  Originality 

2.40 

1. 96 

3.  26 

2,28 

5.  Memorization 

3.  69 

2.  02 

1  4.  99 

1.  16 

6.  Problem  Sensitivity 

4,  67 

1.28 

5.  51 

0.  64 

7.  Mathematical  Reasoning 

2.  94 

2.  11 

2.95 

2.  06 

8.  Number  Facility 

2.  56 

2.  01 

2,  34 

1.  93 

9.  Deductive  Reasoning 

3.  41 

1. 63 

4.44 

1.45 

10.  Inductive  Reasoning 

2.  96 

2.  19 

3.  67 

1.  85 

11.  Information  Ordering 

3.  81 

1. 21 

4.  87 

0.  68 

12.  Category  Flexibility 

2.  54 

2.  39 

3.  06 

2.  20 

13.  Spatial  Orientation 

4.  93 

0.  98 

6.  35 

0.  86 

14.  Visualization 

2.  78 

1.74 

5.47 

1. 30 

15.  Speed  of  Closure 

2.  61 

2.  04 

4.45 

1. 97 

16.  Flexibility  of  Closure 

4.  98 

1. 51 

4.  61 

2.  12 

17.  Selective  Attention 

3.  46 

2.  28 

5.  24 

0.  08 

18.  Time  Sharing 

4.  53 

1.  23 

4.  56 

1.  10 

19.  Perceptual  Speed 

4.  42 

1.  01 

5. 15 

1.  10 

20.  Static  Strength 

1. 97 

2.25 

2.45 

2.  00 

21.  Explosive  Strength 

1.  19 

1.71 

1.  32 

1.92 

22.  Dynamic  Strength 

1.  35 

1. 68 

0.79 

1.  20 

23.  Stamina 

1.49 

1.  15 

2.  06 

1.  93 

24.  Extent  Flexibility 

1. 70 

0.  76 

1. 80 

1.49 

25.  Dynamic  Flexibility 

2.  32 

1.  44 

3.  15 

2.  36 

26.  Gross  Body  Equilibrium 

1.  21 

1. 68 

2.  75 

2.  18 

27.  Choice  Reaction  Time 

5.  19 

0.  87 

4.  81 

1.  50 

28.  Reaction  Time 

4.  18 

1.  13 

5.40 

0.  58 

29.  Speed  of  Limb  Movement 

3.  32 

1.  84 

4.  54 

1.43 

30.  Wrist  Finger  Speed 

3.22 

2.  21 

4.  19 

1.  36 

31.  Gross  Body  Equilibrium 

1. 26 

1. 27 

3.  73 

1.  98 

32.  Multilimb  Coordination 

3.  34 

1.  91 

5.  04 

1.  18 

33.  Finger  Dexterity 

1.  70 

1.  92 

3.  21 

1.74 

34.  Manual  Dexterity 

3.  05 

2.  14 

4.  66 

1.  50 

35.  Arm-Hand  Steadiness 

3.  54 

2.29 

4.  53 

1.  84 

36.  Rate  Control 

4.  19 

2.  05 

5.  02 

1.95  i 

J  37.  Control  Precision 

4.  93 

1.  02 

5.  90 

0. 70  i 

I 
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TABLE  31 


Means  and  Standard  Deviations  for  Each  of  the  Thirty-Seven  Ability 
Scales  on  Task  6  for  Both  Groups  of  Judges 


Ability 

Group  1 

Group  2 

Mean  S.D. 

Mean  S.D. 

1.  Verbal  Comprehension 

1.25  0.90 

1.40  1.44 

2.  Verbal  Expression 

1.36  1.12 

1.79  1.92 

3.  Ideational  Fluency 

1.32  1.75 

2.94  2.52 

4.  Originality 

2.  81  2.  21 

3.69  2.18 

5.  Memorization 

2.40  1.95 

3.18  1.56 

6.  Problem  Sensitivity 

3.04  1.15 

3.84  1.07 

7.  Mathematical  Reasoning 

0.  58  0.  79 

0.95  1.57 

8.  Number  Facility 

0.61  0.72 

0.70  1.28 

9.  Deductive  Reasoning 

2.92  1.56 

3.20  1.65 

10.  Inductive  Reasoning 

2.00  1.71 

2.08  1.82 

11.  Information  Ordering 

1.78  1.15 

2.99  2.01 

12.  Category  Flexibility 

1.24  1.42 

1.96  1.98 

13.  Spatial  Orientation 

2.84  1.54 

5.29  1.41 

14.  Visualization 

2.41  1.49 

4.11  1.96 

15.  Speed  of  Closure 

1.72  2.08 

4.11  2.15 

16.  Flexibility  of  Closure 

3.79  1.48 

3.44  1.95 

17.  Selective  Attention 

3.45  2.33 

5.  28  0.  88 

18.  Time  Sharing 

3.98  1.65 

4.  25  2.  07 

19.  Perceptual  Speed 

3.55  1.67 

5.32  0.72 

20.  Static  Strength 

2.47  1.96 

2.  75  2.  56 

21.  Explosive  Strength 

4.75  1.14 

6.  33  0.  66 

22.  Dynamic  Strength 

5.54  1.58 

5.04  2.44 

23.  Stamina 

5.76  0.86 

6.59  0.59 

24.  Extent  Flexibility 

4.98  1.29 

5.72  1.17 

25.  Dynamic  Flexibility 

5.65  0.47 

6.51  0.93 

26.  Gross  Body  Equilibrium 

4.75  1.56 

5.72  1.05 

27.  Choice  Reaction  Time 

5.17  1.16 

6.08  1.23 

28.  Reaction  Time 

5.48  0.97 

5.93  0.17  , 

29.  Speed  of  Limb  Movement 

5.60  0.80 

6.39  1.10 

30.  Wrist  Finger  Speed 

5.54  0.49 

5.60  1.10 

31.  Gross  Body  Equilibrium 

5.28  0.  83 

6.53  1.22  j 

32.  Multilimb  Coordination 

3.91  2.05 

6.  09  0.  96 

33.  Finger  Dexterity 

3.25  1.68 

5.06  1.12 

34.  Manual  Dexterity 

4.  69  0.  89 

5.98  0.99 

35.  Arm-Hand  Steadiness 

4.50  1.61 

5.80  0.54 

36.  Rate  Control 

4.69  1.49 

4.59  2.45  | 

37.  Control  Precision 

J 

2.26  1.62 

3.31  2.47  j 

( 


Since  the  percentage  distributions  for  Task  1  which  are  shown 
in  Table  20  can  be  considered  representative  of  the  data  displayed 
in  Tables  20  to  25,  the  following  discussion  will  be  limited  to 
Table  20.  In  general,  most  of  the  percentage  distributions  are 
somewhat  platykurtic.  Such  distributions  reflect  the  finding  in  the 
intraclass  correlation  data  that  large  samples  of  judges  are  required 
to  achieve  substantial  scale  reliability.  This  can  also  be  seen  in 
the  rather  large  standard  deviations  for  the  scale  ratings  on  Task  1 
(Table  26). 

In  the  above  discussion  of  the  r  data  for  both  groups  of  judges 
it  was  noted  that,  on  approximately  one-half  of  the  scales,  reliabil¬ 
ities  in  excess  of  0.  70  were  obtained.  In  examining  the  distributions 
which  underly  these  scales,  it  can  be  seen  that  in  approximately  one- 
half  of  these  cases  the  reliability  is  due  to  agreement  on  a  rating 
of  "zero"  or  on  the  estimate  that  the  ability  was  not  applicable  to 
the  task.  Abilities  1  and  2  are  examples  of  high  reliability  being 
associated  with  agreement  on  a  "zero"  ratine  This  same  tendency 
was  present  in  the  first  pilot  study,  although  in  that  study  the  tendency 
was  more  marked. 

In  addition  to  determining  the  amount  of  reliability  which  could 
be  expected  on  the  individual  scales,  the  data  were  analyzed  to 
determine  the  degree  of  similarity  between  pairs  of  ability  profiles 
on  each  of  the  tasks.  As  in  the  first  pilot  study,  the  statistic  r 

_E 

was  used  for  this  purpose.  For  each  of  the  two  samples  of  judges 

and  on  each  of  the  tasks  a  value  of  r  was  calculated  for  every  pair 

_£ 

of  task  ability-profiles.  For  Group  1  there  were  171  such  possible 
pairs  of  profiles  on  each  of  the  tasks  and  for  Group  2  there  were 
231  pairs  of  profiles  on  each  task.  Table  32  gives  the  number  of 
significant  positive  values  of  r  which  were  found  on  each  of  the 
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tasks.  This  table  also  shows  the  proportion  of  the  total  number  of 
relationships  which  are  represented  by  the  significant,  positive 
values  of  r_.  As  compared  with  the  r  data  from  the  first  pilot 

_E  _£ 

study  (Table  12),  the  data  in  TabLr  32  indicate  substantially  greater 
interprofile  similarity. 

TABLE  32 

Number  of  Significant  Positive  Relationships  Among  the  Judges 
on  the  Six  Tasks  and  the  Proportion  of  the  Total  Number 
of  Relationships  which  the  Positives  Constitute 


Group 

1 

Group 

2 

Number  of 

Proportion 

Number  of 

Proportion 

Task 

Positive  r  , 

_E  b 

of  Total 

Positive  r 

_R  3 

of  Total 

1 

81 

.  47 

96 

.  42 

2 

Q8 

.  57 

145 

.63 

3 

46 

.  27 

61 

.  26 

4 

69 

.  40 

95 

.  41 

5 

36 

.  21 

87 

.  37 

8 

127 

.  74 

146 

.  63 

Table  32  can  also  be  examined  to  determine  whether  the  judges 
were  better  able  to  agree  on  rating  tasks  with  which  they  were 
more  familiar.  To  do  this  the  data  from  the  familiarity  rating 
scales  contained  in  Table  33  needs  to  be  considered.  These  data 
were  calculated  on  the  pooled  judges  (n  =  41).  A  comparison  of 
the  data  in  these  two  tables  indicates  no  strong  relationship  between 
familiarity  with  the  task  description  and  amount  of  agreement  or  inter 
profile  similarity.  Although  the  judges  were  most  familiar  with 
Task  1  (Automobile  driving)  both  Task  2  (Air  traffic  controller)  and 
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Task  6  (Basketball  game)  showed  more  interprofile  agreement. 
Task  2  ranked  rather  low  in  familiarity  while  Task  6  was  second. 


TABLE  33 


Mean  Ratings  on  the  Familiarity  Scales 
for  Each  of  the  Task  Descriptions 


Task  Descriptions 

Familiarity  Scales 

1 

2  3  4  5 

6 

1. 

Degree  ol  understanding 

6.  59 

4.  55 

5.  04 

3.  98 

5.  05 

6.  31 

2. 

Completeness  of  task 

6.  00 

4.  66 

5.  43 

5.  35 

5.  30 

5.  30 

3. 

Clarity  of  task  description 

6.  22 

4.  25 

5.  30 

3.  76 

5.  19 

5.  69 

4. 

Degree  of  familiarity 

6.  54 

2.  33 

2.  74 

2.  29 

1.  98 

5.  83 

5. 

Degree  of  experience 

6.  05 

1,44 

1.  89 

1.  07 

1.22 

4.  47 

6. 

Degree  of  proficiency 

5.49 

0.  99 

1.  59 

0.  75 

0.  77 

3.  99 

Discussion  and  Conclusions 


As  compared  with  the  data  from  the  first  pilot  study,  the  results 
of  the  second  pilot  study  indicate  an  increase  in  scale  reliability  and  inter  ¬ 
judge  agreement.  The  increase  in  scale  reliability  can  be  noted  in  the 
intraclass  correlation  coefficients  for  small  groups  of  judges  (r  ). 

In  the  first  pilot  study  for  the  three  groups  of  judges  30%,  28%,  and 
42%  of  the  r^  values  (Table  4)  exceeded  0.  7  while  for  the  two  groups 
of  judges  in  the  second  pilot  study,  these  percentages  increased  to 
51%  and  49%  (Table  18).  The  impact  of  this  increase  in  scale 
reliability  can  be  seen  in  the  substantial  increase  in  inter-judge 
agreement  (Tables  12  and  32).  For  example,  in  the  first  pilot  study, 
Task  2  exhibited  the  largest  proportion  of  positive  significant  r 

_R 

values  with  0.  12  for  the  AIR  judges  and  0.  13  for  the  APA  judges. 
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In  the  second  pilot  study,  these  proportions  for  Task  2  increased 
to  0,  57  and  0.  63.  Similar  increases  were  present  throughout  the 
data  from  the  second  pilot  study. 

Although  these  reliability  and  agreement  data  would  not  be 
acceptable  in  any  final  form  of  the  TAS,  they  are  quite  encouraging 
concerning  the  further  development  of  these  scales.  The  results  of 
the  second  study  indicate  that,  with  further  development,  the  creation 
of  a  highly  reliable  instrument  is  possible. 

In  the  first  pilot  study,  the  data  and  the  comments  received 
from  the  judges  provides  valuable  information  as  to  how  to  further 
develop  the  rating  scales.  The  second  study,  however,  did  not 
provide  data  or  comments  which  indicated  any  specific  difficulties 
with  the  TAS,  and,  therefore,  no  specific  procedures  for  future 
refinements  for  the  TAS  were  suggested.  In  general,  it  would  appear 
that  some  of  the  definitions  of  the  abilities  are  not  fully  understood 
by  the  judges.  Also,  in  some  cases,  the  distinctions  between  similar 
abilities  are  not  comprehended  with  the  result  that  the  abilities  are 
confused  and  used  interchangeably. 

Some  of  the  future  development  efforts  on  the  TAS  will  center 
around  the  further  refinements  of  the  list  of  abilities.  As  was  noted 
earlier  in  this  report,  work  is  needed  to  develop  a  meaningful  set 
of  ability  definitions  in  the  memory  area.  Both  factor -analytic  and 
theoretical  sources  will  have  to  be  consulted  to  develop  a  set  of 
memory  abilities  which  can  efficiently  account  for  the  "types"  of 
memory  required  for  human  task  performance.  The  area  of  sen¬ 
sation  also  needs  development.  This  area  was  not  covered  at  all  in 
the  list  of  abilities  employed  in  the  second  pilot  study.  However, 
since  the  results  of  the  second  study  were  encouraging  with  respect 
to  the  development  of  the  TAS,  a  major  effort  is  warranted  to 
generate  a  comprehensive  set  of  sensory  abilities  and  their  attendant 
definitions. 
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Finally,  given  that  a  workable,  although  not  final  form  of  the 
TAS  has  been  produced,  some  future  effort  will  be  directed  at  using 
the  instrument  to  classify  tasks  found  in  several  selected  areas  of 
the  human  performance.  If  meaningful  groupings  of  this  literature 
can  be  achieved,  it  will  provide  some  preliminary  estimates  of  the 
validity  of  classifying  human  tasks  with  an  abilities -based  rating 
system.  In  these  latter  phases  of  research  we  will  attempt  to 
answer  questions  such  as  the  following.  Do  tasks  classified  as 
representative  of  the  same  abilities  show  similar  results  when  we 
examine  the  effects  of  specified  procedural  or  training  variables  or 
environmental  stressors? 
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APPENDIX  A 


Preliminary  Developmental  Materials: 


Initial  List  of  Specific  Abilities 
List  of  General  Abilities 


TABLE  1 


Initial  List  of  Specific  Abilities 


1.  VERBAL  COMPREHENSION 

The  ability  to  understand  meanings  of  words  or  ideas. 
EXAMPLE:  Vocabulary  tests -especially  multiple  choice 
and  completion  types. 

2.  ASSOCIA TIONAL  FLUENCY 

Common  to  tasks  requiring  the  production  of  many  single 
and  isolated  words  appropriate  in  meaning  to  a  given  idea 
in  limited  time. 

EXAMPLE:  Produce  as  many  words  opposite  in  meaning 
to  the  word  LARGE  in  two  minutes. 

3.  WORD  FLUENCY 

The  ability  to  produce  many  isolated  words  that  contain  one 
or  more  structural,  essentially  phonetic,  restrictions,  without 
reference  to  the  meanings  of  words. 

EXAMPLE:  Produce  as  many  words  as  possible  ending  with 
the  letters  IAN. 

4.  MEMORY  SPAN 

Common  to  tasks  requiring  perfect  recall  for  immediate  rep¬ 
roduction  of  an  item  series  after  only  one  presentation  of  that 
series.  It  is  important  to  recall  both  the  specific  items  as 
well  as  the  order  of  the  item  listing.  This  ability  is  strongest 
on  letter  and  digit  span  tasks,  but  also  applies  to  syllables  and 
words  as  units  of  information.  Mode  of  presentation  may  be 
either  visual  or  auditory.  Requiring  responses  in  reverse 
order  to  that  originally  presented  seems  to  make  little  dif¬ 
ference. 

EXAMPLE:  After  hearing  a  series  of  letters  or  numbers 
read  aloud,  reproduce  this  series  exactly. 

5.  ASSOCIATIVE  MEMORY  -  MEANINGFUL  PAIRINGS 

Common  to  tasks  which  require  recognition  of  specific  rela¬ 
tionships  between  pairs  of  items,  followed  by  their  applica¬ 
tion  to  formulation  of  new  pairs. 

EXAMPLE:  What  is  the  relationship  between  each  first  and 
last  name  in  this  set:  SAM  MARTIN,  TOM 
MCTAVISH  AND  PAM  MERTON.  Apply  this 
principle  to  combine  TIM  with  either  SMITH  or 
MENSCH. 
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6.  ASSOCIATIVE  MEMORY  -  ARBITRARY  PAIRINGS 

Common  to  tasks  which  require  the  immediate  recall  or  repro¬ 
duction  of  items  of  information  arbitrarily  paired.  It  is  im¬ 
portant  to  learn  particular  item  pairs;  there  is  no  obvious  rela¬ 
tionship  between  them. 

EXAMPLE:  Learn  20  pairs  of  first  and  last  names  so  that  when 
the  last  names  are  presented  in  different  order,  the 
appropriate  first  names  can  be  supplied. 

7.  SYMBOLIC  AND  SEMANTIC  ORDERING 

Common  to  tasks  which  require  the  ordering  of  a  given  symbolic 
or  semantic  information  into  a  meaningful  sequence.  A  goal  and/or 
starting  point  may  or  may  not  be  provided.  Symbolic  information 
includes  numbers  and  letters.  Semantic  information  includes  words, 
sentences  and  pictures.  This  ability  is  strongest  for  ordering  ac¬ 
cording  to  time  sequence  and  somewhat  weak  on  hierarchical  ordering. 
SYMBOLIC  EXAMPLE:  State  the  order  for  a  given  set  of  numeric 

operations  to  reach  another  given  number 
from  the  starting  number  in  3  steps. 
SEMANTIC  EXAMPLE:  List  the  steps  in  appropriate  order  to  com¬ 
plete  a  project,  e.  g. ,  planting  a  new  lawn. 

8.  IDEATIONAL  FLUENCY 

The  ability  to  produce  many  responses  appropriate  to  given  require¬ 
ments  in  limited  time.  Emphasis  is  on  quantity  of  responses  rather 
than  quality. 

EXAMPLE:  Write  as  many  different  ideas  as  possible  on  the  topic 
"A  World  Without  War". 

9.  ORIGINALITY 

The  ability  to  produce  many  unusual,  remotely-associated,  or  clever 
responses  to  a  given  idea. 

EXAMPLE:  List  as  many  clever  consequences  as  possible  which 
could  result  from  the  event  of  everybody  suddenly 
going  blind.  An  unusual  response  here  might  be  that 
all  previously  blind  people  would  become  leaders. 

10.  SEMANTIC  SPONTANEOUS  FLEXIBILITY 

Common  to  tasks  requiring  production  of  many  categories  of  ideas 
appropriate  in  meaning  to  a  given  idea.  A  category  contains  items 
with  common  properties.  The  number  of  idea  categories  produced 
is  critical  rather  than  the  number  of  individual  ideas. 

EXAMPLE:  Form  as  many  subclasses  for  a  given  list  of  words  as 
possible  using  your  own  criteria  for  category  assign¬ 
ment. 
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11.  INDUCTION 

The  ability  to  form  general  concepts  that  will  fit  sets  of  data,  the 
forming  and  trying  out  of  hypotheses. 

EXAMPLE:  When  presented  with  3  groups  each  containing  3 
geometrical  figures  which  are  alike  according  to 
some  rule,  discover  this  rule  and  assign  other 
figures  to  the  most  appropriate  group. 

12.  SYLLOGISTIC  REASONING 

The  ability  to  proceed  from  stated  premises  to  their  necessary 
conclusions.  There  is  but  one  correct  solution  to  each  problem. 
EXAMPLE:  Given  the  statement  "In  the  mid-Pacific  on  Buna- 

Buna,  the  game  of  ticky-ticky  is  played  out-of-doors,  " 
judge  these  inferences:  A.  People  in  Buna-Buna 
like  to  play  games;  B.  Ticky-ticky  is  a  difficult 
game  to  play;  C.  There  is  an  island  called  Buna- 
Buna. 

13.  GENERAL  REASONING 

Common  to  tasks  requiring  problem  solution.  In  previous  research, 
deduction  has  been  considered  a  major  aspect  of  problem  solving. 
Guilford  views  the  understanding  or  structuring  of  the  problem  as 
critical  rather  than  any  type  of  deduction.  Problems  can  be  of  a 
wide  variety  including  those  of  a  mathematical  nature. 

EXAMPLE:  Use  knowledge  of  a  ship's  position  with  respect  to  a 
port,  wind  direction,  ocean  current,  and  direction 
of  heading  to  compute  effective  distance  to  port 
following  certain  rules. 

14.  NUMBER  FACI  ITY 

The  ability  to  accurately  manipulate  numbers  in  arithmetic  operations 
rapidly. 

EXAMPLE:  Add,  subtract,  multiply  or  divided  a  series  of  numbers. 

15.  PROBLEM  SENSITIVITY 

Common  to  tasks  requiring  anticipation  or  sensitivity  to  the  needs 
or  the  consequences  of  a  given  situation  in  meaningful  terms.  One 
must  decide  what  implications  arise  from  the  given  information. 

Needs  or  consequences  are  usually  multiple.  Needs  include  addi¬ 
tion  of  details  to  make  a  given  outlined  program  work  and  the 
raising  of  relevant  questions,  the  answers  to  which  would  help 
solve  a  given  problem.  Consequences  include  forecast  of  future 
events  based  on  given  information  and  ways  of  accomplishing  a 
given  goal  when  provided  with  certain  resources.  Seeing  what  is 
wrong  or  what  difficulties  may  arise  from  given  information  is 
also  included. 
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EXAMPLE:  If  more  girls  than  bo/s  have  been  born  in  the  last 
5  years,  what  effects  can  you  predict  20  years 
hence  if  the  trend  continues? 

16.  SPEED  OF  CLOSURE 

Common  to  tasks  requiring  rapid  identification  of  visual  images  pre¬ 
sented  under  unfavorable  conditions  such  as  mutilation  of  words  or 
objects  peripherally  flashed  letters,  dim  letters  after  bright  stimu¬ 
lation. 

EXAMPLE:  Identify  the  number  flashed  briefly  on  the  screen. 

17.  PERCEPTUAL  SPEED 

Common  to  tasks  requiring  quick  and  accurate  judgment  of  figural 
and  symbolic  information  as  to  similarity  or  diversity.  Such 
decisions  are  based  on  minor  aspects  of  the  information. 

FIGURAL  EXAMPLE:  A  large  aerial  photograph  of  a  city  with  a 

small  number  of  circular  patches  taken  from 
that  same  view  alongside  it  are  to  be  matched 
with  lettered  locations  within  the  complete 
photograph. 

SYMBOLIC  EXAMPLE:  Inspect  pairs  of  multi-digit  numbers  and 

indicate  whether  the  2  numbers  in  each 
pair  are  the  same  or  different. 

18.  SPATIAL  ORIENTATION 

The  ability  to  comprehend  arrangements  and  positions  of  visual 
objects  in  space.  The  observer  is  the  reference  point  in  space. 

May  also  include  kinesthetic  patterns  e.  g.  ,  right -left  discrim¬ 
ination. 

EXAMPLE:  Given  compass  and  artificial  horizon  settings  for  a 
plane  in  flight,  determine  the  position  of  that  plane. 

19.  SPATIAL  SCANNING 

The  ability  to  select  the  one  best  series  of  steps  from  all  given  steps 
to  be  taken  to  achieve  a  given  goal.  This  process  necessitates  rapid 
visual  exploration  of  a  wide  or  complicated  spatial  field  in  order  to 
forsee  consequences  for  each  step  taken.  This  process  may  be  con¬ 
sidered  visual  planning.  For  illustration  of  the  process,  finding  ones 
way  through  a  paper  maze  requires  quick  scanning  of  the  field  for 
openings  following  paths  with  the  eye  and  quickly  rejecting  false 
leads. 

EXAMPLE:  Visually  trace  an  electrical  circuit  diagram  with  over¬ 
lapping  wires  and  indicate  which  pairs  of  terminals 
should  be  attacked  to  the  battery  to  make  it  work. 
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20.  VISUALIZATION 

Common  to  tasks  which  require  formation  of  mental  images  of 
figures  or  objects  as  the y  will  appear  after  certain  changes,  such 
as  unfolding  or  rotation.  The  observer  seems  removed  from  the 
stimulus  pattern  in  that  he  appears  to  manipulate  and  alter  its 
image.  Appropriate  responses  may  be  either  drawn  or  selected 
from  given  alternatives. 

EXAMPLE:  A  piece  of  paper  folded  2  times  has  a  hole  punched 
through  it.  How  would  the  sheet  look  when  fully 
opened? 

21.  AUDITORY  PERCEPTUAL  SPEED 

The  ability  to  distinguish  among  various  symbolic  (code,  number) 
auditory  patterns,  rapidly. 

EXAMPLE:  A  series  of  dots  and  dashes  is  presented.  How 
many  dots  are  in  the  run? 

22.  AUDITORY  RHYTHM  DISCRIMINATION 

Common  to  tasks  requiring  distinction  among  various  rhythms, 
tunes  and  melodies. 

EXAMPLE:  Decide  whether  2  rhythmic  patterns  presented  in 
immediate  succession  are  the  same  or  different. 

23.  ARM  -  HAND  STEADINESS 

The  ability  to  make  precise  arm-hand  positioning  movements  where 
strength  and  speed  are  minimized.  It  extends  to  tasks  which  require 
steadiness  during  movement  as  well  as  those  which  require  a  minimum 
of  tremor  during  maintenance  of  a  steady  arm  position. 

EXAMPLE:  Sight  a  target  with  a  gun. 

24.  CONTROL  PRECISION 

The  ability  to  make  fine,  highly  controlled,  but  not  over -controlled, 
muscular  adjustments,  primarily  where  larger  muscle  groups  are 
involved.  Mo'sf -critical  where  adjustments  must  be  rapid  but  pre¬ 
cise.  Adjustments  are  made  to  visual  stimuli  and  can  involve  arm- 
hand  or  leg. 

EXAMPLE:  Steer  a  car  through  an  obstacle  course. 

25.  AIMING 

Common  to  tasks  which  require  the  placing  of  dots  in  very  small 
circles  where  there  are  a  large  number  of  circles  and  the  task  is 
highly  speeded. 

26.  FINGER  DEXTERITY 

The  ability  to  make  skillful,  controlled  manipulations  of  tiny  objects, 
involving  primarily  the  fingers. 

EXAMPLE:  Assemble  peg,  washer,  collar  units  and  insert  them  in 
small  holes. 
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27.  MANUAL  DEXTERITY 

The  ability  to  make  skillful,  well-controlled  (directed)  arm-hand 
movements  in  manipulating  fairly  large  objects  under  speeded 
conditions. 

EXAMPLE:  As  boxes  pass  by  on  a  conveyor  belt,  put  2  cans  in 
each. 

28.  MULTILUMB  COORDINATION 

The  ability  to  coordinate  the  movement  of  a  number  of  limbs  simul¬ 
taneously.  Best  measured  by  devices  involving  multiple  controls. 
(Hands,  feet,  or  hands  and  feet) 

EXAMPLE:  Operate  the  clutch  and  accelerator  pedals  on  a  car. 

29.  RATE  CONTROL 

Involves  the  timing  of  continuous  anticipatory  motor  adjustments 
relative  to  changes  in  speed  and  direction  of  a  continuously  moving 
target  or  object.  Actual  motor  response  to  change  (rather  than 
verbal  estimate,  e.  g. )  is  necessary.  Extends  to  tasks  involving 
compensatory  as  well  as  following  pursuit  and  to  those  involving 
responses  to  changes  in  rate. 

EXAMPLE:  Track  a  moving  target  by  keeping  a  circle  around  a 

dot  which  changes  in  speed  and  direction  of  movement. 

30.  REACTION  TIME 

The  factor  represents  the  speed  with  which  the  individual  is  able 
to  respond  to  a  stimulus  when  it  appears.  It  is  independ  of  the 
mode  of  presentation  (auditory  or  visual)  and  also  of  the  type  of 
responses  required.  Response  cannot  involve  alternate  choices. 
EXAMPLE:  Depress  a  button  as  soon  as  possible  after  a  buzzer 
is  sounded. 

31.  SPEED  OF  ARM  MOVEMENT 

The  speed  with  which  an  individual  can  make  a  gross,  discrete  arm 
movement  where  accuracy  is  not  required.  There  is  ample  evidence 
that  this  factor  is  independent  of  the  reaction  time  factor. 

EXAMPLE:  Using  a  stylus,  touch  a  series  of  targets  in  rapid  suc¬ 
cession. 

32.  RESPONSE  ORIENTATION 

This  factor  has  been  found  general  to  visual  discrimination  reaction 
tasks  involving  rapid  directional  discrimination  and  orientation  of 
movement.  It  appears  to  involve  the  ability  to  select  the  correct 
movement  in  relation  to  a  given  stimulus,  especially  under  highly 
speeded  condition. 

EXAMPLE:  Flip  a  particular  combination  of  2  switches  (of  4 
available)  in  response  to  a  light  appearing  randomly  in  one  of 
4  locations  on  a  grid. 
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33.  WRIST  -  FINGER  SPEED 

The  ability  to  make  rapid  pendular  (back  and  forth)  and/or  rotary 
wrist  movements  involving  rapid,  repetitive  jabbing  movements 
in  which  accuracy  is  not  critical.  This  ability  does  not  depend 
upon  precise  eye-hand  coordination. 

EXAMPLE:  Tap  alternately  on  two  plates  (separated  by  several 
inches)  as  rapidly  as  possible. 

34.  KINESTHETIC  DISCRIMINATION 

The  ability  to  adjust  to  an  upright  position  in  the  absence  of  visual 
cues,  or  in  the  presence  of  conflicting  or  confusing  visual  cues. 
EXAMPLE:  Adjust  a  tilted  chair  to  an  upright  position  while 
wearing  a  blindfold. 

3  5.  ATTENTION 

The  ability  to  perform  a  task  in  the  presence  of  distraction  or  inter¬ 
ference  without  a  significant  loss  of  efficiency.  The  ability  to  con¬ 
centrate  exclusively  on  the  task  being  performed. 

EXAMPLE:  Read  aloud  in  the  presence  of  randomly  occurring  noise 
bursts. 

36.  DEPTH  PERCEPTION 

The  ability  to  accurately  judge  distances  of  objects  from  a  spe¬ 
cified  point. 

EXAMPLE:  Determine  which  of  two  objects  is  further  away  or 
estimate  the  distance  of  one  or  both. 

37.  COLOR  DISCRIMINATION 

The  ability  to  distinguish  differences  in  color  (hue)  or  to  label  colors 
accurately.  The  differences  in  colors  being  compared  or  labeled  may 
be  small. 

EXAMPLE:  Sort  a  variety  of  color  samples  into  piles  according 
to  the  primary  color  they  are  closest  to. 

38.  NEAR  VISUAL  ACUITY 

The  ability  to  distinguish  fine  detail  in  real  objects  or  printed  or 
graphic  material.  The  objects  or  materials  are  at  arms  length  or 
closer  to  the  viewer. 

EXAMPLE:  Determine  if  a  given  stimulus  consits  of  2  lines 
separated  by  a  small  space  or  one  wide  line. 

39.  FAR  VISUAL  ACUITY 

Same  as  for  near  visual  acuity  except  that  the  stimuli  are  at  a 
greater  distance  from  the  viewer  (i.  e.  ,  greater  than  arms  length 
away). 


<? 
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40.  TIME  SHARING 

The  ability  to  obtain  and  utilize  information  presented  within  more 
than  one  visual  display.  (Operator  must  be  at  least  30  inches  from 
the  console  and  the  displays  must  be  separated  by  at  least  16  inches.  ) 
EXAMPLE:  Driving  a  car  into  a  sharp  curve,  determine  which 

gear  is  appropriate  by  checking  tachometer  while  also 
observing  position  on  the  road. 

41.  EXPLOSIVE  STRENGTH 

Common  to  tasks  which  require  expenditure  of  a  maximum  of  energy 
in  one  or  a  series  of  explosive  acts.  This  factor  emphasizes  the 
mobilization  of  energy  for  a  burst  of  effort,  rather  than  continuous 
strain,  stress  or  repeated  exertion  of  muscles. 

EXAMPLE:  Throw  a  softball  as  far  as  possible  without  moving 
your  feet. 

42.  STATIC  STRENGTH 

Common  to  tasks  which  require  the  exertion  of  a  maximum  strength 
against  a  fairly  immovable  external  object  even  for  a  brief  period. 

It  is  general  to  different  muscle  groups  (hand,  arm,  back,  shoulder, 
legs)  and  to  different  kinds  of  tasks. 

EXAMPLE:  Squeeze  a  grip  dynamometer  as  hard  as  possible. 

43.  DYNAMIC  STRENGTH 

The  ability  to  exert  muscular  force  repeatedly  or  continuously  over 
time.  It  represents  muscular  endurance  and  emphasizes  the  re¬ 
sistance  of  the  muscles  to  fatigue.  Tests  loaded  on  this  factor  tend 
to  emphasize  the  power  of  the  muscles  to  propel,  support  or  move 
the  body  repeatedly  or  to  support  it  for  long  periods. 

EXAMPLE:  Perform  as  many  sit-ups  as  possible. 

44.  EXTENT  FLEXIBILITY 

The  ability  to  extend  or  stretch  the  body.  Tests  which  load  on  this 
factor  require  stretching  of  the  trunk  and  back  muscles  as  far  as 
possible,  without  speed,  either  laterally,  forward  or  backward. 
EXAMPLE:  Twist  as  far  around  as  possible  touching  scale  on  the 
wall. 

45.  DYNAMIC  FLEXIBILITY 

Common  to  tasks  which  require  rapid  and  repeated  trunk  and/or 
limb  movements.  Emphasizes  both  speed  and  flexibility. 

EXAMPLE:  Without  moving  your  feet,  as  rapidly  as  possible, 
bend  and  touch  a  spot  on  the  floor,  stand  up,  twist 
and  touch  a  spot  on  the  wall  behind. 

46.  GROSS  BODY  EQUILIBRIUM 

Defined  by  balance  tests  involving  maintenance  of  body  equilibrium. 
EXAMPLE:  With  your  eyes  closed  and  your  hands  on  your  hips, 
balance  on  one  foot. 
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TABLE  1  Cont'd. 


47.  GROSS  BODY  COORDINATION 

The  ability  to  perform  a  number  of  body  movements  simultaneously. 
EXAMPLE:  Holding  the  ends  of  a  short  rope  in  each  hand,  jump 
over  the  rope  without  tripping,  falling  or  releasing 
the  rope. 

48.  STAMINA  (CARDIOVASCULAR  ENDURANCE) 

The  ability  to  extend  a  maximum  amount  of  exertion  with  the 
entire  body  over  a  prolonged  period  of  time. 

EXAMPLE:  Run  a  distance  of  one  mile  as  fast  as  possible. 


TABLE  2 


List  of  General  Abilities 

1.  COGNITION 

Awareness,  immediate  discovery  or  rediscovery,  or  recognition 
of  information  in  various  forms  such  as  figures,  symbols  or  words; 
comprehension  or  understanding. 

2.  MEMORY 

Retention  or  storage,  with  some  degree  of  availability,  of  infor¬ 
mation  in  the  same  form  it  was  committed  to  storage  and  in 
response  to  the  same  cues  in  connection  with  which  it  was  learned. 

3.  DIVERGENT  PRODUCTION 

Generation  of  information  from  given  information,  where  the  emphasis 
is  upon  variety  and  quantity  of  output  from  the  same  source.  Likely 
to  involve  transfer,  that  is,  recall  of  information  by  cues  not 
originally  associated  with  the  information.  Generally,  the  type  of 
problem  requiring  this  activity  has  few  restrictions  allowing  for  a 
broad  search  for  relevant  information.  The  output  is  in  quantity 
and  the  criteria  for  success  are  vague,  somewhat  lax,  and  may 
stress  variety  and  quantity.  Examples  of  such  problems  are  the 
production  of  many  titles  for  a  given  short  story  or  the  production  of 
many  words  opposite  in  meaning  to  a  given  word.  This  ability  is 
most  clearly  involved  in  aptitudes  of  creative  potential. 

4.  CONVERGENT  PRODUCTION 

Generation  of  information  from  given  information,  where  the  emphasis 
is  upon  achieving  unique  or  conventionally  accepted  best  outcomes.  It 
is  likely  that  the  given  (cue)  information  fully  determines  the  response. 
Generally,  the  type  of  problem  requiring  this  activity  is  well  structured 
so  that  the  search  for  relevant  information  is  narrow.  Output  is  limited 
and  the  criteria  for  success  is  sharper,  more  rigorous  and  demanding. 
Examples  of  such  problems  are  deciding  upon  an  appropriate  name  or 
summarixing  word  for  any  given  information  or  ordering  information 
into  a  meaningful  sequence. 

5.  EVALUATION 

Comparison  of  two  or  more  items  of  given  information  based  on 
stated  criteria  resulting  in  a  decision  concerning  degree  of  criteria 
satisfaction.  Criteria  may  include  identity,  similarity  and  con- 
consistency.  Comparison  of  a  single  item  of  information  with  past 
experience  on  similar  items  according  to  stated  criteria  resulting 
in  a  decision  about  degree  of  criteria  satisfaction.  Criteria  can 
include  correctness,  suitability,  adequacy  and  desirability. 
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TABLE  2  Cont;d. 

6.  PRECISION 

The  ability  to  make  fine,  well -controlled  movements  or  muscular 
adjustments  involving  the  arms  and/or  hands.  Includes  maintenance 
of  steadiness  during  movement  or  a  steadiness  during  movement 
or  a  steadiness  of  position. 

7.  DEXTERITY 

The  ability  to  make  skillful,  controlled  manipulations  of  either 
the  arms,  hands  or  fingers  in  handling  objects  of  various  sizes. 

8.  SPEED  OF  MOVEMENT 

The  ability  to  make  rapid,  discrete  movements  where  accuracy  or 
precision  are  not  required.  Movements  may  involve  the  arm,  hand 
or  fingers.  The  critical  component  of  this  ability  is  speed. 

9.  COORDINATION 

The  ability  to  coordinate  the  movement  of  a  number  of  limbs 
simultaneously  or  the  body  as  a  whole.  Also  includes  maintenance 
or  achievement  of  balance  or  equilibrium. 

10.  MOVEMENT  DISCRIMINATION 

The  ability  to  select  the  correct  movement  from  several  alternatives 
or  to  adjust  movement  (speed  and/or  direction)  in  response  to  changes 
in  a  moving  stimulus  or  target. 

11.  STRENGTH 

The  ability  to  exert  a  maximum  amount  of  force  with  any  part  of 
the  body  for  a  given  period  of  time.  The  effort  may  be  continuous 
or  in  repeating  bursts. 

12.  FLEXIBILITY 

The  ability  to  stretch,  twist,  or  rotate  the  body.  The  movement 
may  involve  speed  such  as  in  rapid  alternation  or  change  of  direc¬ 
tion  or  it  may  involve  movement  to  limits  (e.  g.  ,  bend  backwards 
as  far  as  possible). 
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First  Pilot  Study  Materials.- 


Rating  Instructions 
Task  Assessment  Scales 
Task  Descriptions 
Answer  Sheets 


INSTRUCTIONS 


Background 

The  purpose  of  the  present  study  is  to  investigate  a  method  of  analyzing 
task  performance  using  a  list  of  defined  human  ’‘abilities"  as  task  descrip¬ 
tors.  An  ability  is  defined  as  a  general  trait  or  capacity  of  an  individual  to 
perform  a  number  of  specific  activities.  Each  individual  possesses  a  set 
of  abilities  which,  when  taken  together,  may  account  for  his  overall  per¬ 
formance  capacity. 

It  may  be  helpful  to  think  of  abilities  as  analogous  to  the  notions  of 
traits  or  talents.  It  is  often  the  case  that  a  particular  person  is  thought  of 
as  "athletic"  or  "musically  inclined.  "  However,  the  abilities  isolated  so 
far,  are  more  carefully  delineated  than  this  in  describing  man's  performance 
potential. 

The  list  of  abilities  enclosed  can  be  used  to  analyze  any  task  (simple 
to  complex)  in  terms  of  the  types  of  performance  capacities  which  would  be 
required.  The  performance  of  any  given  task  may  require  the  presence 
of  one  or  more  of  these  abilities.  Furthermore,  the  levels  of  the 
abilities  involved  would  probably  be  different.  The  individual  who  possesses 
a  higher  level  of  these  necessary  abilities  would  theoretically  perform  better 
on  the  given  task  than  the  individual  who  exhibits  a  lower  amount  of  these 
same  abilities.  The  basic  notions  here  are:  1)  A  task  can  be  defined  in 
terms  of  the  abilities  required  to  perform  it;  and  2)  Assuming  individuals 
can  be  tested  for  each  of  these  abilities,  that  individual  who  possesses  the 
specified  abilities  to  the  greatest  extent  would  be  predicted  as  the  one  who 
would  best  perform  the  task. 

Procedure 

Include'd  in  the  kit  of  materials  you  have  received  is  a  background 
information  card  which  we  would  like  you  to  fill  out.  This  card  is  followed  by 
three  task  descriptions  selected  from  the  experimental  and/or  task  analysis 
literature.  The  task  descriptions  are  numbered  1  through  3.  Please  observe 
this  order  when  reviewing  them.  Each  task  description  is  followed  by  a  set 
of  answer  sheets  for  each  task.  The  final  item  included  in  your  kit  of 
materials  is  the  Ability  Description  Form  which  contains  the  definitions 
for  50  different  abilities. 

Now  look  at  the  first  set  of  answer  sheets.  You  will  notice  3  columns. 

The  first  column  contains  the  labels  of  all  the  abilities  in  the  same  order  as 
they  appear  on  the  Ability  Description  Form.  The  second  and  third  columns 
are  to  be  filled  out  by  you.  The  degree  of  importance  of  each  ability  for  the 
task  you  have  just  read  is  based  on  a  3  point  scale  which  is  defined  as  follows: 
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The  ability  is  not  at  all  involved  in  the 
performance  of  the  task. 

The  ability  is  required  in  the  task,  but 
it  does  not  contribute  to  individual  dif¬ 
ferences  in  performance.  This  may  be 
thought  of  as  a  "base-line"  level  of  ability, 
that  is,  the  "average"  person  would  exhibit 
the  amount  of  ability  required. 

The  ability  is  involved  in  the  task  and  it 
does  contribute  to  individual  differences 
in  performance.  This  may  be  thought  of 
as  above  a  base-line  level  of  ability,  that 
is,  the  average  person  does  not  exhibit 
the  amount  of  ability  required  to  perform 
the  task.  The  task  requires  a  high  degree 
of  this  ability. 

Please  read  the  first  ability  description  on  the  Ability  Description  Form. 
Decide  whether  or  not  the  ability  as  defined  is  required  in  performance  of 
the  task  you  just  read.  Caution:  Please  note  that  the  "names"  attached  to 
each  ability  definition  (e.  g.  ,  Verbal  Comprehension)  are  provided  only  as 
convenient  labels.  It  is  important  that  you  use  the  definition  for  each  ability 
as  stated  rather  than  any  definition  which  you  might  have  from  previous 
experience  with  these  labels  in  other  contexts.  If  the  ability  is  involved, 
decide  to  what  extent  it  is  required.  Then  write  down  the  number  (0,  1, 

2)  you  feel  is  most  appropriate  in  the  column  headed  "Degree  of  Importance.  ", 
Continue  through  the  remaining  ability  descriptions  in  this  fashion,  thus 
completing  Column  2. 

In  the  last  column,  rank  from  highest  to  lowest  (1  to  N),  those  abilities 
you  indicated  as  critical  for  this  task  in  terms  of  their  relative  contribution 
to  good  performance.  That  is,  if  you  select  a  person  for  this  task  with  only 
one  above  average  (critical)  level  of  an  ability,  which  ability  would  you  most 
want  him  to  have?  Assign  that  ability  #  1  in  Column  3.  If  you  could  select  a 
person  with  the  first  critical  ability  and  one  other  above  average  level  ability, 
what  second  ability  do  you  feel  he  should  have?  Assign  that  ability  # 2.  Con¬ 
tinue  in  this  manner,  assigning  the  appropriate  number  to  each  of  your  listed 
critical  abilities.  Then  answer  the  two  questions  at  the  bottom  of  the  page. 

Proceed  in  this  fashion  through  the  remaining  two  tasks. 

Please  return  all  materials  in  the  self-addressed  envelope  to: 


0  -  Not  Involved: 


1  -  Base-Line: 


2  -  Critical: 


American  Institutes  for  Research 

8555  Sixteenth  Street 

Silver  Spring,  Maryland  20910 
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ABILITY  DESCRIPTION  FORM 


1.  VERBAL  COMPREHENSION 

The  ability  to  understand  meanings  of  words  or  ideas.  This  ability 
involves  more  precise  knowledge  of  exact  meanings  or  distinctions 
between  fine  shadi  ngs  of  meaning  as  well  as  breadth  of  knowledge  of 
less  familiar  words  or  ideas. 

EXAMPLES:  (1)  Pick  the  word  from  the  following  which  is  closest 

in  meaning  to  the  word  HARBINGER:  (a)  forerunner 
(b)  well-tailored  (c)  fortune  teller  (d)  port 

(2)  Given  the  word  LAMP,  which  of  these  alternatives 

is  closest  in  meaning:  TORCH,  BURNER,  CANDLE, 
LANTERN? 

2.  ASSOCIATIONAL  FLUENCY 

Common  to  tasks  requiring  the  production  of  many  single  and  isolated 
words  appropriate  in  meaning  to  a  given  word  or  idea  increases  the 
scope  of  possible  words  which  can  be  appropriate. 

EXAMPLES:  (1)  Produce  as  many  words  as  possible  opposite  in 
meaning  to  the  word  LARGE  in  2  minutes. 

(2)  Fill  in  the  blank  in  the  follov  ing  sentence  with  as 
many  alternate  words  as  you  can  think  of  in  3 
minutes:  HIS  SMILE  IS  AS  WIDE  AS  A  (N) 

3.  WORD  FLUENCY 

The  ability  to  produce  many  isolated  words  that  contain  one  or  more 
structural,  essentially  phonetic,  restrictions,  without  reference  to 
the  meanings  of  words.  As  the  number  or  kind  of  specifications 
become  more  restrictive  (e.  g. ,  specifying  more  than  2  letters  or 
requiring  production  of  words  that  rhyme  with  a  given  word), 
loading  in  this  factor  decreses  while  loading  on  VERBAL  COMPRE¬ 
HENSION  increases. 

EXAMPLES:  (1)  Produce  as  many  words  as  possible  ending  with  the 
letters  CK. 

(2)  Produce  as  many  words  as  possible  that  begin  with 
the  letter  D  and  end  with  the  letter  E. 

4.  SERIAL  RECALL 

The  ability  to  recall  and  reproduce  a  series  of  items  after  one  or 
more  presentations  of  that  series.  It  is  important  to  recall  both 
the  specific  items  as  well  as  the  order  of  the  items  in  the  list.  This 
ability  is  strongest  on  letter  and  digit  span  tasks,  but  also  applies 
to  syllables  and  words  as  units  of  information.  Mode  of  presentation 
may  be  either  visual  or  auditory.  Requiring  responses  in  reverse 
order  to  that  originally  presented  seems  to  make  little  difference. 
EXAMPLES:  (1)  After  hearing  a  series  of  letters  read  aloud, 
reproduce  this  Series  exactly. 

(2)  Recall  a  phone  number  after  looking  it  up  in  the 
telephone  directory. 
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FREE  RECALL 

The  ability  to  recall  and  reproduce  a  series  of  items  after  one  or 
more  presentations  of  that  series.  It  is  important  to  recall  the 
specific  items  in  the  list,  but  they  need  not  be  recalled  in  any 
particular  order.  Mode  of  presentation  may  be  either  visual 
or  auditory. 

EXAMPLE:  (1)  After  hearing  a  series  of  letters  read  aloud,  recall 
all  the  letters  in  any  order. 

6.  PAIRED  ASSOCIATE  MEMORY 

Common  to  taks  which  require  the  recall  or  reproduction  of  items 
of  information  arbitrarily  paired.  It  is  important  to  learn  particular 
item  groupings.  There  is  no  obvious  relationship  between  the  members 
of  a  pair  and  no  logical  way  of  getting  from  one  pair  member  to  the 
other  except  by  rote  memory. 

EXAMPLE:  (1)  Learn  20  pairs  of  first  and  last  names  so  that  when 
the  last  names  are  presented  in  different  order, 
the  appropriate  first  names  can  be  supplied. 

7.  MEMORY  FOR  OPERATIONS 

The  ability  to  remember  logical  connections  or  meaningful  relationships 
among  previously  learned  items  of  information  (e.  g.  ,  mathematical 
formulas,  operating  procedures). 

EXAMPLES:  (1)  Choose  word  pairs  that  have  the  same  sense- 
direction  relationships  as  the  ones  given  on  a 
previously  studied  page. 

Sample  Study  Item:  Sample  Test  Item:  Highway 

Alley-Highway  A.  Lion-Kitten 

B.  Creek-River 

C.  Boat-River 

D.  Track-Train 

(2)  A  doctor  examining  a  patient  determines  the  type 
of  illness  by  relating  the  symptoms  of  the  patient 
to  knowledge  of  various  disease  symptoms. 

8.  MEMORY  FOR  IDEAS 

The  ability  to  recall  the  essence  of  previous  studied  material 
(e.  g.  ,  the  main  point  or  topic  of  a  paragrah).  Rote  recall  of  this 
material  (e.  g.  ,  specific  words  or  sentences)  is  not  required. 

Responses  may  be  either  written  or  oral. 

EXAMPLES:  (1)  List  the  main  ideas  in  the  short  story  you  just 
finished  reading. 

(2)  Present  a  prepared  speech  without  the  use  of  notes. 

9.  SYMBOLIC  AND  SEMANTIC  ORDERING 

Common  totasks  which  require  the  ordering  of  given  symbolic  or 
semantic  information  into  the  most  meaningful  or  best  sequence.  A 
starting  point  and/or  goal  may  or  may  not  be  provided.  Symbolic 
information  includes  numbers,  letters  and  pictures.  Semantic 
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information  includes  words  and  sentences.  This  ability  is  strongest 
for  ordering  according  to  time  sequence  and  somewhat  weak  on 
hierarchical  ordering. 

SYMBOLIC  EXAMPLE:  State  the  order  for  a  given  set  of  numeric 

operations  to  reach  another  given  number 
from  the  starting  number  in  3  steps, 
e.  g.  ,  Given  the  number  6,  order  the  following 
three  operations  so  that  the  number  18 
would  be  obtained.  A  3 

B  +2 
C  x  3 

SEMANTIC  EXAMPLE:  Given  a  series  of  steps  to  complete  a 

project,  e.  g.  ,  planting  a  lawn,  determine 
the  best  order  to  complete  this  project. 

10.  IDEATIONAL  FLUENCY 

The  ability  to  produce  many  verbal  responses  appropriate  to  given 
requirements  in  limited  time.  Emphasis  is  on  quantity  of  responses 
rather  than  quality.  Types  of  activities  which  involve  this  ability 
are:  production  of  ideas  appropriate  to  a  given  topic  or  theme, 
production  of  titles  appropriate  to  a  given  story  or  article,  and 
naming  of  objects  which  meet  one  or  more  specifications.  In  this 
last  instance,  this  ability  is  strongest  for  2  specifications,  fairly 
strong  for  1,  and  becomes  weaker  as  specifications  increase 
beyond  2. 

EXAMPLES:  (1)  Write  as  many  different  ideas  as  possible  on  the 

topic  A  WORLD  WITHOUT  WAR.  (A  time  limit 
of  10-15  minutes  is  specified). 

(2)  Name  as  many  objects  as  you  can  that  are  ROUND 
AND  WHITE. 


11.  ORIGINALITY 

The  ability  to  produce  many  unusual,  remotely-associated,  or  clever 
responses  to  a  single  given  idea.  The  ability  to  improvise  procedures 
in  an  unusual  situation  where  standard  operating  procedures  do  not 
apply. 

EXAMPLE:  List  as  many  clever  consequences  as  possible  which 
could  result  from  the  event  of  everybody  suddenly 
going  blind.  An  unusual  response  here  might  be  that 
all  previously  blind  people  would  become  leaders. 

12.  CATEGORY  FLEXIBILITY 

Common  to  tasks  requiring  production  of  many  categories  of  ideas 
appropriate  in  meaning  to  a  given  idea  or  situation  where  there  are  a 
large  number  of  possible  responses.  A  category  contains  at  least  2 
items  with  some  common  property  to  be  determined  by  the  individual. 
The  number  of  idea  categories  produced  is  critical  rather  than  the 
number  of  individual  ideas. 
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13.  INDUCTION 

The  ability  to  find  general  concepts  that  will  fit  sets  of  data,  the 
forming  and  trying  out  of  hypotheses. 

EXAMPLES:  (1)  When  presented  with  3  groups  each  containing  3 
geometrical  figures  which  are  alike  according  to 
some  rule,  discover  this  rule  and  assign  other 
figures  to  the  most  appropriate  group. 

(2)  Given  this  number  series:  1,  2,  4,  7,  11  -  pick 
the  number  from  the  following  which  follows  the 
rule  for  this  series  and  should  appear  in  the  blank: 
a)  12  b)  14  c)  16  d)  17 

14.  SYLLOGISTIC  REASONING 

The  ability  to  proceed  from  stated  premises  to  their  necessary 
conclusions.  Of  the  alternative  conclusions  possible,  only  one  can 
most  adequately  be  drawn  based  on  the  information  provided  in  the 
premise(s). 

EXAMPLES:  (1)  Given  the  statement:  In  the  mid-Pacific,  on  Buna- 
Buna,  the  game  of  ticky-ticky  is  played  out  of 
doors,  choose  the  best  inference  from  those  which 
follow:  A.  People  in  Buna-Buna  like  to  play  games; 
B.  Ticky-Ticky  is  a  difficult  game  to  play;  C.  There 
is  an  island  called  Buna -Buna. 

(2)  Given  these  statements:  No  A  are  B;  All  A  are  C, 

choose  the  correct  inference  from  those  which  follow: 
a)  Some  C  are  B;  b)  Not  all  C  are  B;  c)  Not  all  B 
are  C;  d)  Some  that  are  B  are  C. 

15.  ARITHMETIC  REASONING 

Common  to  tasks  requiring  the  understanding  or  structuring  of  arith¬ 
metic  word  problems.  This  process  involves  a  decision  as  to  what 
operations  must  be  performed  to  solve  a  problem.  A  decision  as  to 
what,  if  any,  additional  information  is  required  to  reach  a  solution 
may  also  be  necessary.  There  is  but  one  correct  solution  to  each 
problem.  Actual  manipulation  of  numbers  is  not  included  here. 
EXAMPLE:  A  rectangular  tank  is  being  built  to  hold  water.  It  is  to 
be  5'  high  and  9'  long.  How  many  cubic  feet  of  water 
will  it  hold?  a)  Given  the  formula  for  volume  you  decide 
that  the  additional  information  needed,  here  is  width  of 
the  tank,  b)  If  the  width  is  46",  then  the  ooerations 
necessary  to  solve  this  problem  are  to  make  all  dimen¬ 
sions  either  inches  or  feet  and  then  multiply  the  three 
dimensions  together. 

16.  NUMBER  FACILITY 

The  ability  to  accurately  and  rapidly  manipulate  numbers  in  arithmetic 
operations. 

EXAMPLE:  Add,  subtract,  multiply  or  divide  a  series  of  numbers. 
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17.  PROBLEM  SENSITIVITY 

Common  to  tasks  requiring  anticipation  or  sensitivity  to  the  needs 
or  the  consequences  of  a  given  situation  in  meaningful  terms.  One 
must  decide  what  implications  arise  from  the  given  information. 

Needs  or  consequences  are  usually  multiple.  Needs  include  addi¬ 
tion  of  details  to  make  a  given  outlined  program  work  and  the 
raising  of  relevant  questions,  the  answers  to  which  would  aid  in  the 
selection  of  an  appropriate  solution  to  a  given  problem.  Consequences 
include  forecast  of  future  events  based  on  given  information  and  ways 
of  accomplishing  a  given  goal  when  provided  with  certain  resources. 
Seeing  what  is  wrong  or  what  difficulties  may  arise  from  given  infor¬ 
mation  is  also  included.  This  ability  does  not  extend  to  mathematical 
considerations. 

EXAMPLES:  (1)  If  more  girls  than  boys  have  been  born  in  the  last 

5  years,  what  effect  can  you  predict  20  years  hence 
if  the  trend  continues? 

(2)  List  at  least  4  things  you  would  take  into  consideration 
in  selecting  the  site  for  a  hamburger  stand  you  plan 
to  build. 

18.  FLEXIBILITY  OF  CLOSURE 

The  ability  to  perceive  or  detect  the  relevant  stimulus  (previously 
specified)  in  the  presence  of  distracting  materials  or  "noise".  The 
stimulus  can  be  either  visual  or  auditory. 

EXAMPLES:  (1)  Find  all  the  words  containing  the  letter  "A"  in  this 
list  of  40  words. 

(2)  Detect  targets  of  interest  when  they  appear  on  a  radar 
scope. 

(3)  Determine  if  a  given  pattern  of  sounds  includes  the 
relevant  coded  stimulus. 

19.  PERCEPTUAL  SPEED 

Common  to  tasks  requiring  quick  and  accurate  judgment  as  to  whether 
or  not  2  items  of  figural  or  symbolic  information  are  exactly  the  same. 
Such  decisions  are  based  on  fine  distinctions  between  similar  items  of 
info  rmation. 

FIGURAL  EXAMPLE:  Circular  patches  taken  from  a  large  aerial 

photograph  of  a  city  are  to  be  matched  with 
lettered  locations  within  a  complete  photograph 
of  the  same  view. 

SYMBOLIC  EXAMPLE:  Inspect  pairs  of  multi -digit  numbers  and  indicate 

whether  the  numbers  in  each  pair  are  the  same 
or  different. 

20.  SPATIAL  ORIENTATION 

The  ability  to  comprehend  arrangements  and  positions  of  visual  objects 
in  space.  The  observer  is  the  frame  of  reference.  Also  include 
kinesthetic  patterns,  e.  g.  ,  right-left  discrimination. 
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EXAMPLES:  (1)  Given  compass  and  artificial  horizon  settings  for  a 

plane  in  flight,  followed  by  5  photographs  showing 
an  airplane  in  5  different  positions,  choose  the 
picture  which  agrees  with  the  two  instrument  readings. 
(2)  A  series  of  hands  are  pictured  in  different  positions. 
Decide  whether  each  hand  shown  is  the  right  or  left. 
(Usually,  the  individual  uses  his  own  hands  to  match 
the  positions  shown  in  the  pictures.  ) 

21.  SPATIAL  SCANNING 

The  ability  to  select  the  one  best  series  of  steps  from  all  possible 
steps  to  be  taken  to  achieve  a  given  goal.  This  process  necessitates 
rapid  visual  exploration  of  a  wide  or  complicated  spatial  field  in  order 
to  foresee  consequences  for  each  step  taken.  This  process  may  be 
considered  visual  planning.  For  illustration  of  the  process,  finding 
ones  way  through  a  paper  maze  requires  quick  scanning  of  the  field 
for  openings,  following  paths  with  the  eye,  and  quickly  rejecting  false 
leads. 

EXAMPLE:  Visually  trace  an  electrical  circuit  diagram  with  over¬ 
lapping  wires  and  indicate  which  pairs  of  terminals 
should  be  attached  to  the  battery  to  make  it  work. 

22.  VI'  aLIZATION 

Common  to  tasks  which  require  formation  of  mental  images  of  figures 
or  objects  as  they  will  appear  after  certain  changes,  such  as  unfolding, 
rotation  or  movement  of  some  type.  The  observer  seems  removed 
from  the  stimulus  pattern  in  that  he  appears  to  manipulate  and  alter 
its  image.  Appropriate  responses  may  be  either  sketched  or  selected 
from  given  alternatives. 

EXAMPLE:  A  piece  of  paper  folded  2  times  has  a  hole  punched  through 
it.  How  would  the  sheet  look  when  fully  opened? 

23.  AUDITORY  PERCEPTUAL  SPEED 

The  ability  to  distinguish  among  various  {symbolic  (code,  number) 
auditory  patterns,  rapidly. 

EXAMPLES:  (1)  A  series  of  dots  and  dashes  is  presented.  How 

many  dots  are  in  the  run? 

(2)  A  series  of  numbers  are  rapidly  read  aloud.  Write 
them  down  accurately  without  falling  behind. 

24.  AUDITORY  RHYTHM  DISCRIMINATION 

Common  to  tasks  requiring  distinction  among  various  rhythms,  tunes 
and  melodies. 

EXAMPLE:  Decide  whether  2  rhythmic  patterns  presented  in  immediate 
succession  are  the  same  or  different. 
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25.  ARM  -  HAND  STEADINESS 

The  ability  to  make  precise  arm-hand  positioning  movements  where 
strength  and  speed  are  minimized.  It  extends  to  tasks  which  require 
steadiness  during  movement  as  well  as  those  which  require  a  minimum 
of  tremor  while  maintaining  a  static  arm  position. 

EXAMPLE:  Sight  a  target  with  a  gun. 

26.  CONTROL  PRECISION 

The  ability  to  make  fine,  highly  controlled  muscular  movements 
required  to  adjust  the  position  of  a  control  mechanism.  Examples 
of  control  mechanisms  are  joy  sticks,  levers,  pedals  and  rudders.  A 
series  of  adjustments  may  be  required,  but  they  need  not  be  performed 
simultaneously.  This  ability  is  most  critical  where  adjustments  must 
be  rapid  but  precise.  Adjustments  are  made  to  visual  stimuli  and 
involve  the  use  of  a  single  limb,  either  arm-hand  or  leg. 

EXAMPLE:  Operate  a  joy  stick  to  steer  an  aircraft. 

27.  FINGER  DEXTERITY 

The  ability  to  make  skillful,  controlled  manipulations  of  objects  small 
enough  to  be  handled  with  the  fingers. 

EXAMPLE:  Assemble  peg,  washer,  collar  units  and  insert  them  in 
small  holes. 

28.  MANUAL  DEXTERITY 

The  ability  to  make  skillful,  well-directed  arm-hand  movements  in 
manipulating  fairly  large  objects  under  speeded  conditions. 

EXAMPLE:  As  boxes  pass  by  on  a  conveyor  belt,  put  1  can  in  each. 

29.  MULTILIMB  COORDINATION 

The  ability  to  coordinate  the  movement  of  a  number  of  limbs  simultaneously. 
Best  measured  by  devices  involving  multiple  controls.  (Hands,  feet, 
or  hands  and  feet) 

EXAMPLES:  (1)  Operate  the  clutch  and  accelerator  pedals  on  a  car. 

(2)  Ride  a  bicycle. 

30.  RATE  CONTROL 

Involves  the  timing  of  continuous  anticipatory  motor  adjustments 
relative  to  changes  in  speed  and/or  direction  of  a  continuously  moving 
target  or  object.  Actual  motor  response  to  change  (rather  than  verbal 
estimate)  is  necessary.  Extends  to  tasks  involving  compensatory  as 
well  as  following  pursuit  and  to  those  involving  responses  to  changes  in 
rate. 

EXAMPLE:  Track  a  moving  target  by  keeping  a  circle  around  a  dot 
which  changes  in  speed  and  direction  of  movement. 

31.  REACTION  TIME 

This  ability  represents  the  speed  with  which  the  individual  can  provide 
a  single  motor  response  to  a  single  stimulus  when  it  appears.  It  is 
independent  of  the  mode  of  presentation  (auditory  or  visual)  and  also 
of  the  type  of  motor  response  required.  Response  cannot  involve 
alternate  choices. 
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32.  SPEED  OF  ARM  MOVEMENT 

The  speed  with  which  an  individual  can  make  a  gross,  discrete  arm 
movement  where  accuracy  is  minimized.  There  is  ample  evidence 
that  this  ability  is  independent  of  reaction  time. 

EXAMPLE:  Using  a  stylus,  touch  a  series  of  targets  in  rapid 
succession. 

33.  RESPONSE  ORIENTATION 

This  factor  has  been  found  general  to  visual  discrimination  tasks. 

These  tasks  involved  rapid  recognition  of  the  direction  (e.  g.  ,  North, 
South,  East,  West)  indicated  by  a  particular  visual  stimuli  (e.  g. ,  an 
arrow)  followed  by  the  appropriate  motor  response  chosen  from  several 
alternatives.  The  response  may  be  simple  or  complex  (i.  e.  ,  push  a 
button  and  pull  a  switch  vs.  push  a  button).  This  ability  appears  to  be 
most  critical  when  the  conditions  are  highly  speeded. 

EXAMPLE:  Flip  a  particular  combination  of  2  switches  (or  4  available) 
in  response  to  a  light  appearing  randomly  in  one  of  4 
locations  on  a  grid. 

34.  WRIST  -  FINGER  SPEED 

The  ability  to  make  rapid  pendular  (back  and  forth)  and/or  rotary 
wrist  movements  involving  repetitive  jabbing  where  accuracy  is  not 
critical.  This  ability  does  not  depend  upon  precise  eye-hand  co¬ 
ordination. 

EXAMPLE:  Tap  alternately  on  two  plates  (separated  by  several 
inches)  as  rapidly  as  possible. 

35.  VERBAL  EXPRESSION 

The  ability  to  clearly  and  concisely  to  communicate  one  c,  mojre  ideas 
to  another  person  or  persons.  Mode  of  communication  may  be  either 
oral  or  written. 

EXAMPLE:  By  phone,  give  explicit  directions  to  the  tourist  so  that 
he  can  reach  his  desired  destination. 

36.  ATTENTION 

The  ability  to  perform  a  task  in  the  presence  of  distraction  or  inter¬ 
ference  without  a  significant  loss  of  efficiency.  The  ability  to  con¬ 
centrate  exclusively  on  the  task  being  performed. 

EXAMPLE:  Read  aloud  in  the  presence  of  randomly  occuring  noise 
bursts. 

37.  TIME  SHARING 

The  ability  to  obtain  and  utilize  information  presented  within  more 
than  one  visual  display.  The  operator  must  be  at  least  30  inches 
from  the  console  and  the  displays  must  be  separated  by  at  least  16 
inches  for  this  ability  to  be  involved. 

EXAMPLE:  Driving  a  car  into  a  sharp  curve,  determine  which  gear 
is  appropriate  by  checking  tachometer  while  also 
observing  position  on  the  road. 
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38.  EXPLOSIVE  STRENGTH 

Common  to  tasks  which  require  expenditure  of  a  maximum  of  energy 
in  one  or  a  series  of  explosive  acts.  This  factor  emphasizes  the 
mobilization  of  energy  for  a  burst  of  effort,  rather  than  continuous 
strain,  stress  or  repeated  exertion  of  muscles. 

EXAMPLE:  Throw  a  softball  as  far  as  possible  without  moving  your 
feet. 

39.  STATIC  STRENGTH 

Common  to  tasks  which  require  the  exertion  of  maximum  strength 
against  a  fairly  immovable  external  object  even  for  a  brief  period. 

It  is  general  to  different  muscle  groups  (hand,  arm,  back  shoulder, 
leg)  and  to  different  kinds  of  tasks. 

EXAMPLE:  Squeeze  a  grip  dynamometer  as  hard  as  possible. 

40.  DYNAMIC  STRENGTH 

The  ability  to  exert  muscular  force  repeatedly  or  continuously  over 
time.  It  represents  muscular  endurance  and  emphasizes  the  resistance 
of  the  muscles  to  fatigue.  Tests  loading  on  this  factor  tend  to  emphasize 
the  power  of  the  muscles  to  proper  support  or  move  the  body  repeatedly 
or  to  support  it  for  long  periods. 

EXAMPLE:  Perform  as  many  sit -ups  as  possible. 

41.  EXTENT  FLEXIBILITY 

The  ability  to  extend  or  stretch  the  body.  Tests  which  load  on  this 
factor  require  stretching  of  the  trunk  and  back  muscles  as  far  as 
possible,  without  speed,  either  laterally,  forward  or  backward. 
EXAMPLE:  Twist  as  far  arouud  as  possible  touching  the  scale  on  die  wall. 

42.  DYNAMIC  FLEXIBILITY 

Common  to  tasks  which  require  rapid  and  repeated  trunk  and/or  limb 
movements.  Emphasizes  both  speed  and  flexibility. 

EXAMPLE:  Without  moving  your  feet,  bend  and  touch  a  spot  on  the 
floor,  stand  up,  twist  and  touch  a  spot  on  the  wall 
behind  as  rapidly  as  possible. 

43.  GROSS  BODY  EQUILIBRIUM 

The  ability  to  maintain  or  regain  body  balance  especially  in  situations 
where  equilibrium  is  threatened  or  temporarily  lost. 

EXAMPLE:  With  your  eyes  closed  and  your  hands  on  your  hips, 
balance,  on  one  foot. 

44.  GROSS  BODY  COORDINATION 

The  ability  to  simultaneously  perform  movements  which  involve  the 
entire  body. 

EXAMPLE:  Holding  the  ends  of  a  short  rope  in  each  hand,  jump  over 
over  the  rope  without  tripping,  falling  or  releasing  rope. 


-101- 


45.  STAMINA  (CARDIOVASCULAR  ENDURANCE)  ’ 

The  ability  to  extend  a  maximum  amount  of  exertion  with  the  entire 
body  over  a  prolonged  period  of  time. 

EXAMPLE:  Run  a  uistance  of  one  mile  as  fast  as  you  can. 

46.  DEPTH  PERCEPTION 

The  ability  to  judge  the  relative  distance  of  2  or  more  objects  from 
the  observer.  Also,  the  ability  to  provide  approximate  distance  of 
one  or  more  objects  from  a  specified  point.  In  this  case,  the  closer 
the  distance  estimate  to  the  actual  distance,  the  higher  the  ability 
level. 

EXAMPLE:  Determine  which  of  two  objects  is  further  away  or  esti¬ 
mate  the  distance  of  one  or  both. 

47.  COLOR  DISCRIMINATION 

The  ability  to  distinguish  differences  in  color  (hue)  where  the  differences 
in  colors  being  compared  may  be  small. 

EXAMPLE:  Sort  a  variety  of  color  samples  into  piles  according  to  the 
primary  color  they  are  closest  to. 

48.  NEAR  VISUAL  ACUITY 

The  ability  to  distinguish  fine  detail  in  real  objects  or  printed  on 
graphic  material.  The  objects  or  materials  are  at  arms  length  or 
closer  to  the  viewer. 

49.  FAR  VISUAL  ACUITY 

Same  as  for  near  visual  acuity  except  that  the  stimuli  are  at  a  greater 
distance  from  the  viewer  (i.  e. ,  greater  than  arms  length  away). 

50.  KINESTHETIC  DISCRIMINATION 

The  ability  to  adjust  to  an  upright  position  in  the  absence  of  visual 
cues,  or  in  the  presence  of  conflicting  or  confusing  visual  cues. 
EXAMPLE:  Adjust  a  tilted  cha'r  to  an  upright  position  while  wearing 
a  blindfold. 


TASK  DESCRIPTION  #1 


Apparatus :  A  polar  pursuit  tracking  device  was  used  in  which  £  held  a  rigid  stylus  equipped 
with  a  photoelectric  cell  to  track  a  moving  target  light.  The  device  was  patterned  after 
a  prototype  originally  developed  in  the  Psychology  Laboratory  at  Cornell  University  and 
was  re-designed  by  the  senior  author  and  constructed  by  Shaw  Laboratories,  Syosset,  N.  Y. 

S  was  confronted  with  a  typical  rotary  pursuit-type  display  in  which  the  target  rotated 
at  60  rpm.  The  target  was  a  3/4*  x  3/4"  square  portion  of  a  lucite  disc  and  was  illuminated 
by  a  doughnut -type  fluorescent  fixture  mounted  underneath  its  surface.  Two  sides  of  the 
target  were  in  effect  segments  of  two  concentric  circles  of  6.25”  and  7* 75”  In  diameter 
respectively.  The  remainder  of  the  rotating  lucite  disc,  which  was  18"  in  diameter  and 
3/16”  thick  was  painted  black.  A  sheet  of  plate  glass  l/4M  thick  and  20  x  20"  square 
was  mounted  over  the  rotating  disc.  Its  rear  surface  was  covered  with  black  masking 
tape,  a  17"  diameter  portion  of  which  was  stripped  away  to  permit  the  target  and  a  major 
portion  of  the  black  rotating  disc  to  be  visible  to  S.  The  center  of  the  target  area 
rotated  on  a  3.5"  orbit  and  generated  a  total  linear  distance  of  22"  per  sec. 

S*s  response  member  consisted  of  a  rigid  stylus,  in  the  tip  of  which  was  inserted  a 
photoelectric  cell  which  was  activated  by  the  light  transmitted  through  the  glass  plate 
from  the  target.  The  stylus  had  a  corrugated  hand  grip  3  1/2"  long  and  1"  in  diameter, 
with  a  stem  protruding  approximately  4",  at  the  end  of  which  was  a  90  degree  bend.  The 
length  of  the  bent  portion  was  1  l/2".  The  diameter  of  the  stylus  tip  was  3/8"  and  the 
opening  into  which  light  was  admitted  was  3/l6”  in  diameter.  S  held  the  stylus  horizon¬ 
tally  over  the  glass  plate  so  that  the  stylus  tip  pointed  downward  and  was  kept  perpendicular 
to  the  glass  plate  at  all  times  during  performance. 

The  three  stimulus  displays  consisted  of: 

1.  a  standard  RP  display  labelled  NOTAF  (for  no  extra  guidance)  where  S  received  the 
usual  target  and  background  information. 

2.  an  on-target  augmented  display  called  OOTAF  where  the  standard  display  infor¬ 
mation  was  augmented  by  means  of  a  10  watt  "bug"  light  but  manufactured  by  the  General 
Electric  Co.  The  bulb  was  mounted  in  a  standard  photoflood -type  corrugated  reflector 
which  was  clipped  to  a  stand  4*  above  and  to  the  rear  of  the  display.  The  linear  distance 
from  the  light  to  the  center  of  the  display  was  3,3"  •  The  light  was  directed  at  an  angle 
of  approximately  45  degrees  to  the  surface  of  the  display  in  such  a  way  as  to  eliminate 
undesirable  reflections,  When  the  light  came  on,  the  entire  surface  was  bathed  in  yellow 
light.  Whenever  S  was  "on-target,"  activation  of  the  photoelectric  circuit  caused  a 
relay  closure  which  turned  on  the  yellow  light.  the  tlme  delay  between  target  acquisition 
and  appearance  of  the  light  was  determined  by  the  inherent  delay  in  the  relay  closure 

and  the  bulb  filament  warm-up  time,  which  was  determined  to  be  0.150  +  0.010  sec. 

3.  an  off -target  augmented  display  called  OFTAF.  which  was  identical  to  ONTAF  with 
the  exception  that  the  yellow  light  came  on  after  S  discontinued  contact  with  the  target 
and  remained  on  until  the  next  acquisition. 

E1 s  controls  consisted  of  a  motor  speed  control  and  meter  with  which  to  monitor 
target  rotation  as  well  as  a  stylus  sensitivity  control  which  was  used  to  adjust  the 
sensitivity  of  the  photoelectric  cell.  Sensitivity  was  adjusted  so  that  S  was  Judged 
to  be  "on-target"  whenever  the  center  of  the  stylus  aperture  passed  over  the  edge  of  the 
targe  t . 


S»s  performance  was  measured  by  a  0.01  sec.  timer  with  an  accuracy  of  +  0.005  sec. 
constructed  by  the  Standard  Electric  Time  Co.,  and  a  Sodeco  impulse  counter  which 
registered  the  number  of  target  contacts  on  each  trial.  Steps  were  taken  to  sound¬ 
proof  the  recording  apparatus. 

Experimental  Design  and  Procedure?  The  experiment  made  use  of  three  groups  of  15  Ss 
each.  One  group  was  labelled  N0TAP  and  consisted  of  the  control  group  which  received 
standard  visual  information.  Group  0FTAF  rece!ved  off -target  AP  and  Group  0NTAF  received 
on-target  AP.  Testing  sessions  were  conducted  over  a  two-lay  period  and  consisted  of  2 1 
training  trials  during  the  first  session  and  12  during  the  second  session,  one  week 
later,  for  a  total  of  35  training  trials.  Immediately  after  training  during  the  second 
session  nine  transfer  trials  were  administered  during  which  all  AF  was  removed.  Trial 
lengths  were  20  sec.  each  with  20  sec.  rests  between  each  trial.  One-minute  rests  were 
given  after  each  3-trial  block. 

Ss  in  Group  OFTAF  were  told  that  a  yellow  light  (which  was  demonstrated)  would  come 
on  whenever  they  were  off  target  whereas  Ss  in  Group  ONTAF  were  told  it  would  come  on 
when  they  were  on  target.  Control  Ss  (NOTAF)  were  simply  given  the  standard  instruction 
In  which  they  were  told  to  keep  the  stylus  tip  in  contract  with  the  moving  target  to  the 
best  of  their  ability.  When  £s  began  the  task,  they  were  given  a  pair  of  ear  protectors, 
similar  to  those  used  by  aircraft  ground  crews,  to  supplement  the  sound-masking  steps 
taken  to  eliminate  auditory  cues  from  the  apparatus.  They  were  instructed  in  the  use 
of  the  display,  and  it  was  demonstrated  when  they  were  "on  target"  and  whey  they  were 
"off  target.”  They  were  asked  to  place  the  stylus  tip  on  a  small  marked-off  square 
proximal  to  the  circle  of  rotation  and  to  keep  itthere  when  the  signal  "ready"  was 
given.  he  signal  "ready”  was  given  3  sec.  before  the  signal  "begin,"  and  "stop"  20 
sec.  later.  S*s  performance  was  recorded  for  each  20-sec.  trial  as  TOT  in  hundredths  of 
a  second  and  total  number  of  target  contracts. 


TASK  DESCRIPTION  #2 


A  simulated  approach-control  task  was  used 
In  which  subjects  (Ss)  served  as  radar  controllers 
(RCs)  who  were  responsible  for  directing  aircraft 
through  an  approach  gate.  The  approaches  were  to 
be  effected  at  a  prescribed  rate,  and  two  Ss  were 
required  to  alternate  In  controlling  approaches. 
That  is,  the  first  approach  was  to  be  directed  by 
RCi,  the  second  by  RCg  *  and  then  RCj  assumed  res¬ 
ponsibility  for  the  third  incoming  aircraft,  and 
sc  on. 


The  RCs  delivered  instructions  to  pilots 
over  a  voice-communication  channel,  and  the  pilots 
carried  out  the  instructions  faithfully  and  with¬ 
out  delay  by  appropriate  manipulation  of  their 
consoles.  The  RC-to-p 1 lot  communication  protocol 
required  that  the  RC  first  identify  the  pilot  and 
then  Issue  the  command,  for  example,  "Bravo  one, 
speed  200  knots”;  In  return,  the  pilot  was  to  im¬ 
mediately  confirm  the  command,  for  example,  "Roger, 
Bravo  one,  speed  200  knots."  The  RCs  gave  only 
heading  and  speed  commands  to  the  pilots;  altitude 
was  intentionally  omitted  from  consideration  in 
order  to  maintain  a  reasonable  level  of  task  diffi¬ 
culty. 


Pig.  1.  Reproduction  of  the 
display  at  the  start  of  a  session. 


The  radar  display  as  it  appeared  at  the  beginning  of  a  session  is  reproduced  in  Figure  1. 
The  approach  gate  was  located  precisely  at  the  center  of  the  displayed  airspace,  and  all  air¬ 
craft  entered  the  airspace  from  the  eastern  (right-hand)  periphery.  The  display  was  marked  with 
the  periphery  to  the  approach  gate  represented  100  miles.  The  aircraft  appearing  in  the  north¬ 
east  sector  of  the  scope  were  designated  as  "Alpha"  aircraft,  and  those  appearing  In  the  south 
east  sector  were  referred  to  as  "Bravo"  aircraft.  The  Alpha  and  Bravo  aircraft  were  indicated 
by  different  codes.  The  RCs  were  not  allowed  to  write  down  the  specific  codes  for  any  of  the 
planes.  The  two  RCs  monitored  the  same  airspace  but  on  dlffozent  displays,  and  they  could  speak 
to  one  another  only  over  a  voice-communication  channel.  The  Alpha  RC  was  assigned  to  the  Alpha 
aircraft,  the  Bravo  RC  to  the  Bravo  aircraft. 


At  the  beginning  of  a  session,  four  alpha  aircraft  were  spaced  evenly  along  the  eastern 
periphery  of  the  airspace.  An  Alpha  aircraft  made  the  first  approach,  a  Bravo  aircraft  followed, 
then  another  Alpha  aircraft,  and  so  on.  A  successful  approach  occurred  when  an  aircraft  entered 
the  approach  gate  at  200  kn.  on  a  heading  of  2  70°.  A  "miss"  occurred  If  an  aircraft  in  the  Inner 
circle  of  the  display  crossed  the  longitudinal  axis  into  the  western  half  of  the  airspace  In  any 
condition  not  constituting  a  successful  approach. 

Within  a  sector,  the  planes  could  fly  at  any  heading  specified  by  the  RC  as  long  as  the 
final  approach  was  made  at  a  heading  of  270°  and  a  speed  of  200  kn.  The  RCs  could  do  simple 
computations  where  necessary  to  aid  them  in  directing  their  aircraft.  The  required  approach 
rate  (system  criterion)  was  an  approach  every  2  min.  A  compensatory  arrangement  was  employed. 
That  is,  a  given  approach  was  to  compensate  for  the  accumulated  time  error.  Hence,  If  a  time 
error  of  20  sec.  late  has  accrued  over  prior  approaches,  the  next  approach  was  to  be  20  sec. 
early  so  that  the  average  of  the  approach  times  would  equal  the  system  criterion  of  2  min. 
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A  clock  system  was  mounted  on  the  wall  In  front  of  the  team  In  such  a  way  that  the  RCs 
could  keep  continuous  track  of  their  temporal  progress  In  guiding  aircraft  through  the  approach 
gate.  Each  clock  kept  time  In  terms  of  minutes  and  seconds  up  to  1  hour,  and  could  be  viewed 
by  only  a  slight  shift  In  an  RCs  line  of  vision  from  the  Input  display. 

The  following  aspects  of  the  task  characterized  both  team  arrangements:  (a)  A  small  red 
light  indicated  whose  turn  it  was  to  effect  an  approach;  (b)  the  timing  started  upon  the  com¬ 
pletion  of  the  first  approach  cf  the  session;  and  (c)  Immediate  feedback  was  provided  to  the  RC 
team  of  time  errors  (relative  to  the  compensatory  or  non-compensatory  criteria),  misses,  and 
safety  infractions  Immediately  after  each  approach  except  the  f'rst. 


TASK  DESCRIPTION  #3 

SHEET  METAL  WORKER:  USING  HAND  LEVER  PUNCH 

1.  Marks  point  on  sheet  metal  where  punch  hole  is  to  be  made. 

2.  Selects  appropriate  punch  and  die  to  be  used. 

3.  Unscrews  die  with  screwdriver  or  key  furnished  with  the  punch. 

4.  Opens  punch  by  lifting  lever. 

5.  Unscrews  threaded  collar. 

6.  Lifts  pu  ch  from  collar  (if  other  one  is  there). 

7.  Inserts  desired  punch  in  collar. 

8.  Screws  on  threaded  collar. 

9.  Depresses  lever  to  normal  position. 

10.  Inserts  and  screws  desired  die  into  position. 

11.  Turns  die  so  that  the  end  of  the  punch  enters  the  die  approximately  l/l6,f 
when  levers  are  in  normal  or  closed  position. 

12.  Opens  punch. 

13.  Irserts  sheet  metal  lntp  punch. 

14.  Centers  punch  (centering  point  of  punch  is  placed  in  the  prick  point  made 
during  layout). 

1 9.  Presses  down  on  lever  to  punch  hole. 

16.  Opens  punch  by  lifting  lever. 

17.  Visually  inspects  size  and  appearance  of  punched  hole. 
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TASK  DESCRIPTION  #4 


In  order  to  perform  the  task  to  be  described,  it  is  necessary  to  understand  some  orbital 
dynamics  concepts. 

See  Figure  1. 

The  first  figure  shows  a  space  vehicle  in  orbit  around  the  earth.  Orbit  1  is  a  circular 
orbit.  If  a  retrograde  or  slowing  down  thrust  Is  applied  as  shown  In  the  figure,  elliptical 
trajectories  result.  Orbit  2  is  such  an  ellipse.  As  the  vehicle  falls  toward  the  earth  It 
gains  velocity.  The  increase  in  velocity  Is  sufficient  to  cause  It  to  regain  altitude,  but 
as  it  climbs  it  slows  down  again  resulting  In  the  elliptic  path.  Orbit  3  results  from 
enough  deceleration  to  cause  the  vehicle  to  re-enter  the  atmosphere  before  regaining  suf¬ 
ficient  velocity  to  climb. 

Now  look  at  the  second  figure.  Orbit  1  Is  again  a  circular  orbit.  The  thrust  applied 
as  shown  would  cause  the  vehicle  to  accelerate  and  move  Into  orbit  2.  This  orbit  is  also  an 
ellipse,  since  as  the  vehicle  gains  altitude,  it  slows  down  and  begins  to  fall.  As  the 
vehicle  falls  it  gains  velocity  and  begins  to  climb  as  in  the  first  case.  If  a  second  thrust 
is  applied  at  the  highest  point  in  the  orbit  (apogee),  shewn  by  the  dotted  line,  orbit  3  Is 
attained.  This  is  a  circular  orbit  higher  than  orbit  1.  This  is  the  most  efficient  way  to 
change  orbits.  Thrust  is  used  only  twice,  the  remainder  of  the  time  is  spent  coasting. 
Similar  two-impulse  transfers  exist  for  any  orbit  change. 

The  purpose  of  these  figures  Is  to  shew  what  happens  when  thrust  Is  applied  to  an  orbit¬ 
ing  vehicle. 

Now  look  at  figure  3a.  The  circle  with  the  corss  in  it  represents  a  vehicle  in  a 
circular  orbit  around  the  earth.  Part  of  the  earth  can  be  seen  below  the  vehicle.  The 
figure  is  now  centers i  on  the  vehicle  and  referenced  to  an  imaginary  line  between  the 
vehicle  and  the  center  of  the  earth.  Thus  the  earth  would  appear  to  turn  under  the  "ehicle 
instead  of  the  vehicle  turning  about  the  earth.  The  situation  is  exactly  the  same  in 
Figures  1  and  2,  only  the  view  is  changed.  The  dotted  box  surrounds  the  area  of  interest 
for  one  type  of  rendezvous.  That  is  the  area  ahead  of  and  above  and  below  the  target 
vehicle  • 

See  Figure  3b. 

Consider  the  path  of  a  second  vehicle  attempting  to  rendezvous  with  the  target  vehicle. 

If  the  second  vehicle  is  initially  directly  ahead  of  the  target  at  the  same  altitude  and 
speed  (shown  in  Figure  3b)  it  must;  slow  down  to  allow  the  target  to  catch  up.  If  the 
interceptor  simply  slows  up  he  will  lose  altitude  and  follow  path  1.  This  path  obviously 
will  not  allow  him  to  rendezvous  with  the  target.  He  must  thrust  upward  to  maintain  his 
altitude  at  the  same  time  that  he  slows  down.  If  the  proper  combination  cf  thrusts  are 
applied  he  might  follow  path  2.  All  that  would  remain  for  him  to  do  would  be  tc  ac¬ 
celerate  to  the  same  velocity  as  the  target  so  that  at  intercept  they  would  have  no  (zero) 
relative  velocity. 

p 

Each  subjects  monitors  predictor  display  on  a  cathode  ray  tube.  It  shows  you  the  inter¬ 
ceptor^  predicted  path  for  a  five  minute  period.  The  right  hand  end  of  the  trace  rep¬ 
resents  the  interceptor]s  present  position.  The  left  hand  end  represents  the  inter¬ 
ceptor^  position  five  minutes  in  the  future.  This  trace  always  represents  a  five  minute 
prediction.  As  you  accelerate  and  decelerate  the  trace  will  appropriately  lengthen  and 
shorten.  If  the  interceptor  is  stopped  relative  to  the  target,  the  trace  will  become  a 
dot.  The  curvature  of  the  trace  results  from  the  orbital  dynamics,  discussed  above, 
operating  on  the  interceptor *s  velocity  vector. 


The  dot  on  the  left  represents  the  target  vehicle.  At  the  start  of  each  rendezvous 
maneuver  the  interceptor  will  be  80,000  feet  ahead  and  20,000  feet  above  the  target.  The 
scale  on  the  display  is  1  inch  =  10,000  feet.  The  task  is  to  rendezvous  with  the  target 
within  15  minutes  using  as  little  fuel  as  possible. 

At  the  beginning  of  each  run  the  iritial  impulse  of  a  two-impulse  transfer  has  been 
initiated  but  not  so  the  subject  will  coast  along  the  best  trajectory.  The  subject  is  to 
correct  the  orbital  path  with  this  controller  and  continue  to  ”fly,r  to  the  target  and 
stop  the  interceptor  at  the  target.  In  order  to  accelerate  the  interceptor  In  a  specific 
direction,  the  subject  displaces  the  control  stick  in  that  same  direction.  The  more  the 
stick  is  displaced  the  more  thrust  that  is  applied.  To  aid  the  subject  in  stopping  at  the 
target  the  scale  is  expanded  when  the  interceptor  gets  close  to  the  target.  When  a  range 
of  10,000  feet  is  reached  (1  inch  from  the  target)  the  scale  will  be  expanded  to  1  inch  = 
1,000  feet. 

The  interceptor  is  to  be  flown  to  the  target,  until  the  dots  touch;  then  the  subject 
stops  the  interceptor.  He  is  to  use  as  little  fuel  as  possible  and  make  his  rendezvous 
within  15  minutes. 


/  \  !  TASK  DESCRIPTION  #5 

He 

The  aiublfects  for  this  experiment  were  four  experienced  pilots  w’th  various  amounts 
of  helicopter  experience.  The  vehicle  used  was  a  Hiller  model  12-E,  similar  to  the  Army 
standard  primary  training  helicopter  but  with  an  engine  of  higher  horsepower. 


The  task  chosen  for  the  study  was  a  series  of  four  power  line  patroal  missions  over 
terrain  unfamiliar  to  the  subjects.  Eight  flight  routes  were  chosen,  each  of  which  required 
approximately  two  hours  for  completion;  pilots  flow  two  routes  on  each  experimental  day. 

Each  pilot  flew  the  routes  in  identical  order.  After  driving  to  or  being  flown  to  a 
starting  point,  subjects  were  given  a  map  showing  rural  electric  pcwor  distribution  lines, 
roads  and  certain  other  terrain  details.  A  particular  line  segment,  usually  about  30  miles 
in  length,  was  marked  in  color  on  the  map.  The  pilot  was  required  to  take  off,  locate  the 
beginning  of  the  line  segment  to  be  patrolled,  then  to  fly  at  slow  speed  along  the  line, 
looking  for  damaged  cross  bars,  broken  insulators  or  other  sources  of  potential  power 
interruption. 


At  a  point  unknown  to  the  subject  in  advance,  the  safety  pilot  who  acted  as  observer 
pointed  out  a  tap,  or  terminal  distribution  line,  to  the  subject,  who  was  required  to  turn 
off  the  mainline  and  inspect  the  tap  to  its  end.  The  subject  then  pulled  up  from  the  line, 
returned  at  higher  speed  to  the  main  line  he  had  left  and  continued  his  patrol.  Another 
tap  was  pointed  out  dur'ng  the  second  hour  ^f  flight,  again  without  prior  wam’ng. 

When  the  subject  completed  his  first  iv.ute  he  proceeded  to  a  nearby  airport,  landed  and 
refueled.  During  appr  x’mately  twenty  minutes  on  the  gr  und  he  studied  his  next  flight  route. 
After  takeoff  he  again  had  to  find  a  line,  patroal  it  and  inspect  another  two  taps  not  marked 
on  his  map. 

The  entire  flight  (except  the  return  from  the  end  of  each  tap  to  the  line  from  which  it 
emanated)  was  conducted  at  altitudes  of  from  20  to  50  feet  and  at  lateral  distances  from  the 
power  lines  of  from  20  to  60  feet.  Pilots  had  to  watch  for  and  avoid  cross  ng  cables  and 
high  tension  lines,  as  well  as  livestock  which  are  apt  to  stampede  when  frightened  by 
helicopters.  The  power  line  maps  used  were  unfamiliar  to  the  subjects,  as  was  the  terrain. 

The  task  thus  incorporated  a  navigation  and  detailed  reconnaisance  function,  together  with 
Intermittent  hazards  which  has  to  be  avoided. 


The  helicopter  was  instrumented  to  allow  monitoring  of  rotor  RPM  and  of  the  positions 
of  three  controls;  the  collective  pitch  lever,  the  throttle,  and  the  cyclic  pitch  control 
stick.  The  collective  pitch  lever  is  used  to  control  the  pitch  on  all  blades  of  the  rotor, 
to  allow  the  helicopter  to  move  in  an  up  or  down  direction.  The  throttle  of  the  same  type 
as  on  a  motorcycle,  is  located  near  the  top  part  of  the  lever.  It  provides  the  power  for 
the  engine.  In  order  to  lift  off,  the  pilot,  using  his  left  hand,  pushes  the  lever  forward 
to  increase  the  pitch  while  at  the  same  time,  he  presses  on  the  throttle  to  provide  the 
necessary  power.  The  cyclic  pitch  control  stick  is  used  to  control  the  pitch  of  each  blade 
individually,  to  allow  the  helicopter  to  move  in  any  direction  other  than  up  or  down.  The 
stick  is  operated  with  the  right  hand. 

As  note),  each  subject  flew  the  four  missions  in  the  same  order.  The  first  and  second 
days  of  flying  were  in  relatively  hilly  terrain,  whereas  the  third  and  fourth  days  were 
over  generally  flat  farmland. 
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TASK  DESCRIPTION  #6 


Subjects 

Seventy-two  young  sailors  served  as  Sz ,  randomly  assigned  to  four  groijps  of  18. 
Visual  Stimuli  and  Task 


The  display  was  tilted  2 5  degrees  from  the  horizontal.  Pour  thousand  five  hundred 
letters,  randomized  by  computer,  were  printed  in  rows  of  10  on  paper  strip.  They  moved 
under  a  slot  which  revealed  each  row  for  2  seconds.  Average  viewing  time  was  0.2  second 
per  letter.  The  task  was  to  cross  off  and  ;ount  four  letters,  two  at  a  time,  until  five 
of  each  member  of  a  pair  had  been  achieved,  followed  by  five  of  each  of  the  other  pair, 
and  to  continue  alternating  the  sets  of  two,  over  a  perxod  of  15  minutes. 

Auditory  Stimuli 

The  same  sound,  lasting  1  second,  was  used  for  all  groups.  It  contained  frequencies 
in  the  band  30-6,000  cycles,  the  major  portion  of  energy  being  in  the  lower  half.  Pre¬ 
sentation  was  through  loudspeakers.  For  N  groups,  sound -pres  sure  level  on  the  C  scale 
was  105  db;  for  Q  groups  it  was  68  db. 

Procedure 


Each  man  was  ^ested  Individually,  some  time  between  the  hours  of  1:30  PM  and  5:00  PM, 
in  a  soirnd -Insulated  room.  The  seated  S  was  first  given  the  appropriate  Instruction  for 
his  group. 

Group  Mj^  was  told, 

This  is  a  memory  experiment.  I  would  like  you  to  look  at  a  list  of  letters, 
like  this,  and  search  for  a  number  of  them.  The  aim  is  to  find  out  how  well 
you  can  memorize  the  number  of  letters  you  need.  The  letters  you  are  looking 
for  are  C,  R,  X,  and  J.  For  for  C  and  R  first,  and  cross  off  each  C  and  R  as 
you  come  to  them  until  you  have  crossed  off  5  Cs  and  5  Rs.  Then  leave  C  and  R, 
and  go  on  to  X  and  J.  Cross  off  5  Xs  and  5  Js.  As  soon  as  you  have  finished 

X  and  J,  start  again  immediately  with  C  and  R.  Go  on  like  that,  one  pair  at  a 

time,  alternately,  ‘until  I  tell  you  to  stop,  after  15  minutes.  The  letters 
rarely  come  together,  for  instance  when  you  have  5  of  one,  you  might  only  have 

2  of  the  other,  but  don*t  start  on  the  next  pair  ‘until  you  have  5  of  each 

letter  in  a  pair.  Always  read  from  left  to  right.  From  time  to  time  there 
is  some  noise  during  this  best.  It*s  in  the  form  of  occasional  short  bursts 
of  noise,  not  very  loud,  but  medium  loud.  Ignore  them,  don*t  let  them  distract 
you,  even  for  a  second,  because  the  idea  is  not  to  let  anything  distract  you 
from  the  test.  1*11  let  you  hear  a  burst  now,  before  we  start,  so  that  you 
know  what  it  is  like. 

Group  M^  was  instructed  similarly,  except  that  "quiet  sound"  was  substituted 
for*hcise,"  with  "very  quiet"  for  the  qualifying  description. 

Group  Sn  was  told, 

This  is  an  experiment  to  see  how  well  you  can  find  particular  letters.  Here 
is  a  list  of  letters  for  you  to  search.  Whenever  you  see  one  of  the  letters 
that  are  needed,  cross  it  off.  Search  carefully  and  try  not  to  miss  any. 


The  letters  to  look  for  are  C,  R,  X,  and  J.  To  make  It  less  boring ,  deal  <mh 
them  In  pairs,  taking  C  and  R  as  the  first  pair.  After  youfve  found  and 
crossed  off  5  Cs  and  5  Rs,  then  start  searching  for  Xs  and  Js.  After  finding 
5  Xs  and  5  Js,  go  back  to  C  and  R,  and  so  on  all  through  the  list,  alter¬ 
nately,  until  I  tell  you  to  stop,  after  15  minutes.  Always  read  from  left 
to  right.  Do  be  extremely  careful  not  to  miss  a  letter.  The  way  we  mark 
this  test  Is,  by  taking  away  points  for  every  mistake.  Each  time  you  miss 
seeing  one  of  the  letters  you  lose  10  points.  Whenever  you  cress  off  the 
wrong  number  for  a  set  of  5,  you  lose  one  point.. 

Then  followed  the  noise  explanation  given  to  M  •  Group  S  was  Instructed  In  the  same 
way  as  Sn,  but  with  the  "quiet  sound"  substitution  given  qto  Mq» 

Instructions  were  followed  by  a  single  demonstration  of  the  auditory  stimulus.  The 
£  practiced  unpaced  for  3  minutes  during  which  the  sound  occurred  twice.  The  practice 
run  was  then  marked  and  shown  to  S,  errors  being  pointed  out  and  counted  -  stra'ght- 
forwardly  for  M  groups,  by  points -penalty  system  for  S  groups.  The  2 -minute  paced 
practice  followed,  accompanied  by  one  burst  of  sound.  Immediately  afterwards  S  performed 
the  test,  during  which  the  sound  was  presente  i  at  minutes;  1/2,2,31/2,5  1/2,  6  1/2, 

7  1/2,  9  1/2,  10  1/2,  12  1/2,  14. 


ANSWER  SHEET 


Ability 

Degree  of  Importance* 

0  «  Not  involved 

1  =  Base-line 

2  =  Critical 

Rank* 

1.  Verbal  Comprehension 

2.  Associational  Fluency 

3.  Word  Fluency 

4.  Serial  Recall 

5*  Free  Recall 

6.  Paired  Associate  Memory 

7  Memory  for  Operations 

1 

8.  Memory  for  Ideas 

9-  Symbolic  and  Semantic  Ordering 

10.  Ideational  Fluency 

11.  Originality 

12.  Category  Flexibility 

13.  Induction 

14.  Syllogistic  Reasoning 

15.  Arithmetic  Reasoning 

16.  Number  Facility 

17.  Problem  Sensitivity 

18.  Flexibility  of  Closure 

• 

19-  Perceptual  Speed 

20.  Spatial  Orientation 

21.  Spatial  Scanning 

22.  Visualization 

23.  Auditory  Perceptual  Speed 

24.  Auditory  Rhythm  Discrimination 

25.  Arm-Hand  Steadiness 

26.  Control  Precision 

27.  Finger  Dexterity 

28.  Manual  Dexterity 

29.  Multilimb  Coordination 

30.  Rate  Control 

31.  Reaction  Time 

>2.  Speed  of  Arm  Movement 

*See  Instructions:  Procedures 
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Ability 

Degree  of  Importance* 

0  «  Not  involved 

1  *  Base-line 

2  »  Critical 

Rank* 

33.  Response  Orientation 

i 

34.  Wrist-Finger  Speed 

35 •  Verbal  Expression 

36.  Attention 

37*  Time  Sharing 

38.  Explosive  Strength 

39*  Static  Strength 

40.  Dynamic  Strength 

41.  Extent  Flexibility 

42.  Dynamic  Flexibility 

43.  Oross  Body  Equilibrium 

44.  Oross  Body  Coordination 

45.  Stamina  (Cardiovascular  Endurance) 

46.  Depth  Perception 

47*  Color  Discrimination 

48.  Near  Visual  Acuity 

49.  Par  Visual  Acuity 

50.  Kinesthetic  Discrimination 

♦See  Instructions:  Procedures 


( 1)  Are  there  any  elements  of  this  task  which  you  feel  you  were  unable  to  analyze  using 
the  ability  descriptions  provided?  Yes  _ _  No  _ 

a)  if  yes,  please  list  these  task  elements. 


(2)  Are  there  any  elements  of  other  tasks  with  which  you  are  familiar  that  cannot  be 
analyzed  using  these  ability  descriptions?  Yes  __  No 

a)  If  yes,  please  list  these  task  elements. 
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APPENDIX  C 


Second  Pilot  Study  Materials: 


Rating  Instructions 
Task  Assessment  Scales 
Task  Descriptions 
Answer  Sheets 


INSTRUCTIONS 


The  kit  of  materials  before  you  consists  of  the  following  items:  1)  a 
reference  manual,  2)  a  set  of  task  descriptions,  and  3)  a  set  of  answer 
sheets  for  each  of  the  task  descriptions.  You  will  be  asked  to  analyze 
each  of  the  task  descriptions  in  terms  of  the  thirty-seven  descriptors  of 
human  abilities  contained  in  the  reference  manual.  As  you  analyze  a  task 
in  terms  of  each  of  the  abilities,  you  will  mark  your  ratings  of  the  task 
on  the  answer  sheets. 

In  rating  the  task  descriptions  you  will  be  making  two  different 
decisions.  First,  you  must  decide  whether  the  ability,  as  it  is  defined 
in  the  manual,  is  required  for  performance  on  the  task  you  are  rating. 
Second,  if  you  decide  that  the  ability  is  required,  you  must  determine 
the  extent  or  degree  to  which  it  is  required.  The  result  of  your  effort 
will  be  a  quantitative  profile  of  the  task  in  terms  of  those  human  abilities 
required  for  its  performance. 

In  analyzing  the  task  descriptions  the  following  procedure  will  be 
employed. 


First,  read  the  task  description  thoroughly  and  with  extreme 
care.  Be  certain  that  you  fully  understand  all  of  the  activities  in  which 
an  operator  or  subject  must  engage  to  complete  the  task.  If  possible, 
you  should  actually  attempt  to  visualize  these  activities  and  go  through 
them  one  by  one.  When  you  fully  understand  the  task  description,  you 
may  begin  to  analyze  it  in  terms  of  the  abilities  in  the  reference  manual. 

Second,  open  your  reference  manual  to  pages  one  and  two  which 
contain  the  first  ability  descriptor.  Begin  by  reading  the  material  pre¬ 
sented  on  the  left-hand  page.  This  page  presents  the  name  of  the 
particular  ability  descriptor,  a  definition  of  it,  and  a  chart  which  dis¬ 
tinguishes  the  ability  you  are  considering  from  other  abilities  which  are 
either  similar  to  it  or  can  easily  be  confused  with  it.  The  definition 
of  the  ability  was  developed  expressly  to  present  the  precise  nature 
of  the  ability  and  to  reveal  its  scope  and  its  limits.  The  chart  below 
the  ability  definition  is  presented  as  a  further  aid  in  determining  the 
extent  of  the  ability.  This  chart  is  nece  ,sary  since  some  abilities 
differ  from  each  other  in  only  one  or  two  critical  aspects  and  therefore, 
might  easily  be  confused. 

When  considering  the  information  presented  on  this  page,  it  is 
quite  important  to  focus  your  attention  upon  the  definition  of  the  ability 
and  upon  the  chart  of  distinctions  rather  than  upon  the  name  of  the 
ability.  It  is  quite  possible  that  you  have  encountered  this  name  in  a 
different  context  where  it  had  a  different  meaning.  If  you  focus  too 
much  attention  upon  the  name  of  the  ability,  this  past  familiarity  with 
the  name  will  interfere  with  your  rating  of  the  task. 

Having  considered  the  information  on  this  page  to  the  point 
where  you  completely  understand  the  ability  as  it  is  defined,  you  are 
ready  to  make  the  first  decision  concerning  this  ability. 
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Third,  based  upon  your  understanding  of  the  ability  you  must 
decide  whether  this  ability  is  required  for  performance  on  the  task 
you  are  considering.  If  your  decision  is  NO,  check  the  box  marked 
DOES  NOT  APPLY  on  your  answer  sheet  for  that  ability.  Having  done 
this,  ignore  the  right-hand  page  and  proceed  to  the  next  ability 
description  and  begin  your  analysis  of  the  task  with  respect  to  that 
description. 

If,  on  the  other  hand,  you  decide  that  some  amount  of  this 
ability  is  required  for  performance  on  the  task,  you  must  determine 
the  amount  of  the  ability  which  is  required.  To  do  this  proceed  to  the 
right-hand  page. 

Fourth,  on  the  right  hand  page  you  will  find  a  seven-point 
scale  relating  to  the  ability  defined  on  the  left-hand  page.  General 
definitions  of  the  high  and  low  levels  of  the  ability  are  presented  to 
the  left  of  the  scale  while  to  the  right  are  examples  of  tasks  which 
display  different  amounts  of  the  ability.  The  definitions  present  the 
critical  factors  which  determine  the  amount  of  the  ability  required. 

In  other  words,  more  than  one  aspect  of  the  task  may  determine  the 
amount  of  the  ability  which  is  required. 

Take  for  example  an  ability  which  is  affected  by  two  aspects 
of  the  task.  A  scale  rating  of  medium  could  be  achieved  by  the  ability 
being  medium  on  both  of  the  underlying  dimensions  or  by  being  high 
on  one  and  low  on  the  other.  It  should  be  noted  that  not  all  of  the 
abilities  vary  over  multiple  dimensions. 

The  examples  which  are  placed  along  the  right-hand  side  of 
the  scale  serve  as  concrete  anchors  for  the  scale.  They  are  there  to 
provide  you  with  reference  points  for  rating  the  task  you  are  consider¬ 
ing.  They  should  be  employed  by  asking  the  question  "Does  the  task 
which  I  am  considering  require  more  or  less  of  the  ability  than  this 
example?  " 

In  rating  the  task,  you  are  attempting  to  estimate  the  lowest 
amount  of  the  ability  a  °ubject  could  possess  and  still  produce  error¬ 
less  performance  on  the  task.  Two  points  are  important  here.  First, 
it  is  possible  that  if  X  amount  of  the  ability  will  yield  errorless  perform¬ 
ance,  an  amount  greater  than  X  will  also  yield  errorless  performance. 
Therefore,  keep  in  mind  that  you  are  asked  to  estimate  X  or  the  lowest 
amount  which  will  still  produce  errorless  performance.  The  second 
point  is  that  you  are  considering  the  amount  of  the  ability  required  for 
performance  and  not  that  required  for  the  learning  of  the  task.  You 
must  assume  that  the  subject  has  already  learned  the  task  and  that  he 
is  now  performing  it  at  an  errorless  level. 

Once  you  have  reached  a  conclusion  as  to  the  amount  of  the 
ability  required  by  the  task  you  are  rating,  mark  your  answer  by 
placing  an  "X"  on  the  rating  scale  on  the  answer  sheet.  Please 
remember  to  use  the  scale  on  the  answer  sheet  and  not  the  one  in  the 
reference  manual. 

Five,  continue  the  procedures  outlined  above  until  you  have  rated 

the  task  with  respect  to  all  thirty-seven  abilities  presented  in  the 
reference  manual. 
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VERBAL  COMPREHENSION 


Characteristic  of  receiver  of  ^  I  Verbal  Expression  (2):  Character 
information.  *  ]  istic  of  sender  of  information, 
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PROBLEM  SENSITIVITY 
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Requires  the  recognition  o i  frequently 
recurring,  typical  problems  and  the 
identification  of  a  few  of  the  relevant 
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Deals  with  understanding  or  Number  Facility  (8):  Deals  with 

structuring  of  mathe-  *  the  manipulation  of  numbers  in 

matical  problems.  mathematical  problems. 
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Decide  whether  or  not  to  take  an  umbrella. 


Requires  the  application  of  a  simple,  I  Given  a  set  of  books  to  arrange,  one  determines  the 

basic  rule  to  explain  an  obvious  relation-  best  Sy8tem  ?s  fiction  and  non-fiction, 

ship  between  two  groups  of  items  or 
among  a  small  number  of  individual  items. 
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vs*  Inductive  Reasoning  (10): 

Discovery  of  the  best  or  most 
appropriate  rules  for  explana- 
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Requires  the  utilization  of  two  channels 
of  rather  simple  information  where  the 
operator  can  shift  sequentially  between 
channels  in  which  the  rate  of  information 
input  is  low. 
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21.  EXPLOSIVE  STRENGTH 
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Dynamic  Strength  (22):  Continu 
or  repeated  strain  or  stress 
muscles  in  supporting  body. 


Stamina  (23):  Involves  prolonged 
physical  activity;  involves  cardio¬ 
vascular  resistance  to  latigus. 
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CHOICE  REACTION  TIME 
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Requires  only  enough  speed  in 
initiation  of  movement  to  respond 
within  a  relatively  long  period  of  time. 


29.  SPEED  OF  LIMB  MOVEMENT 


WRIST-FINGER  SPEED 


quires  a  low  degree  of  coordination 
perform  simple,  familiar  movements 
olving  the  entire  body. 


8 


Involves  coordination  of  two  Gross  Body  Coordination  31  ): 

or  more  limbs;  does  not  *  Involves  the  coordination  of 

extend  to  trunk  movement.  the  entire  body  including  the 

trunk. 


188 


Can  involve  the  manipulation  Rate  Control  (36)  and  Control 

of _objects.  •  Precision  (37):  Involves  the 


Skilled  movements  involving  Finger  Dexterity  (Ji):  Skilled 

mainly  the  hand  and  arm  *  movements  involving  primarily 


Requires  very  skillful,  coordinat 


35.  ARM-HAND  STEADINESS 


35.  ARM -HAND  STEADINESS 


f 


Requires  motor  adjustments  relative 
to  a  target  moving  at  a  constant  speed 
in  a  single  dimension. 


CONTROL  PRECISION 


*jtfh MOttOdl 


Requires  low  level  of  precision 
to  grossly  position  a  control. 


TASK  DESCRIPTION  #1 


A  21  year  old  female  student  is  going  to  drive  a  1968  Chevrolet 
Impala  during  rush  hour  traffic  (approximately  5:30).  The  trip  will 
begin  at  the  University  of  Maryland  and  will  end  at  the  Hecht  Co.  in 
Silver  Spring.  This  car  that  she  will  be  driving  has  a  manual  trans¬ 
mission  (stick  shift,  4  on  the  floor)  and  power  steering  but  no  power 
brakes. 

She  unlocks  her  car,  gets  in  and  turns  the  ignition  on.  Before  back¬ 
ing  up  she  fastens  her  seat  belt  and  turns  the  radio  on.  She  backs  out 
cf  her  parking  space  in  Lot  1  and  makes  a  right  turn  onto  University  Blvd. 
Next,  she  makes  a  right  turn  onto  the  approach  to  Route  1  and  proceeds 
toward  the  Capital  Beltway.  Frequent  stops  and  starts  are  made  on  the 
way  to  the  Beltway  because  traffic  is  heavy.  Upon  arriving  at  the  Beltway, 
she  must  quickly  pull  out  from  the  ramp  to  get  into  the  main  traffic  stream. 

She  is  driving  in  the  right  has\d  lane  at  50  mph  and  notices  an 
accident  up  ahead,  so  she  must  quickly  pull  into  the  center  lane.  The 
rest  of  the  driving  on  the  Beltway  is  marred  by  two  quick  panic  stops. 

She  gets  off  at  Georgia  Avenue  and  continues  down  it  toward  Silver 
Spring.  She  is  traveling  at  30  mph  in  light  to  medium  traffic  with  occasional 
stops  and  starts  or  traffic  lights. 

After  arriving  at  the  Hecht  Co, ,  she  finds  an  empty  parking  space 
between  two  parked  cars  and  must  parallel  park. 


TASK  DESCRIPTION  #2 


A  simulated  approach-control  task  was  used 
In  which  subjects  (Ss)  served  as  radar  controllers 
(RCs)  who  were  responsible  for  directing  aircraft 
through  an  approach  gate.  The  approaches  were  to 
be  effected  at  a  prescribed  rate,  and  two  Ss  were 
required  to  alternate  In  controlling  approaches. 
That  Is,  the  first  approach  was  to  be  directed  by 
RC^,  the  seoond  by  RC  ,  and  then  RC^  assumed  res¬ 
ponsibility  for  the  third  Incoming  aircraft,  and 
so  on. 


The  RCs  delivered  Instructions  to  pilots 
over  a  voice -communication  channel,  and  the  pilots 
carried  out  the  Instructions  faithfully  and  with¬ 
out  delay  by  appropriate  manipulation  of  their 
consoles.  The  RC-to-pilot  communication  protocol 
required  that  the  RC  first  Identify  the  pilot  and 
then  Issue  the  command,  for  example,  "Bravo  one, 
speed  200  knots";  In  return,  the  pilot  was  to  Im¬ 
mediately  confirm  the  oummand,  for  example,  "Roger, 

Bravo  one,  speed  200  knots."  The  RCs  gave  only 
heading  and  speed  commands  to  the  pilots;  altitude 
was  Intentionally  omitted  from  consideration  In 
order  to  maintain  a  reasonable  level  of  task  diffi¬ 
culty. 

The  radar  display  as  It  appeared  at  the  beginning  of  a  session  is  reproduced  In  Figure  1. 
The  approach  gate  was  located  precisely  at  the  center  of  the  displayed  airspace,  and  all  air¬ 
craft  entered  the  airspace  from  the  eastern  (right-hand)  periphery.  The  display  was  marked  with 
oonoentrlo  rings,  and  the  distance  between  adjacent  rings  represented  20  mi.  The  distance  from 
the  periphery  to  the  approach  gate  represented  100  mi  The  aircraft  appearing  in  the  north¬ 
east  sector  of  the  scope  were  designated  as  "Alpha"  aircraft,  and  those  appearing  in  the  south¬ 
east  sector  were  referred  to  as  "Bravo"  aircraft.  The  Alpha  and  Bravo  aircraft  were  indicated 
by  different  codes.  The  RCs  were  not  allowed  to  write  down  the  spec  if io  codes  for  any  of  the 
planes.  The  two  RCs  monitored  the  same  airspace  but  on  different  displays,  and  they  could  speak 
to  one  another  only  over  a  voioe-communioat Ion  channel.  The  Alpha  RC  was  assigned  to  the  Alpha 
aircraft,  the  Bravo  RC  to  the  Bravo  airoraft. 

At  the  beginning  of  a  session,  four  Alpha  aircraft  were  spaced  evenly  along  the  eastern 
periphery  of  the  airspace.  An  Alpha  aircraft  made  the  first  approach,  a  Bravo  airoraft  followed, 
the  another  Alpha  aircraft,  and  so  on.  A  successful  approach  occurred  when  an  aircraft  entered 
the  approaoh  gate  at  200  kn.  on  a  heading  of  270  .  A  "miss"  ocourred  If  an  aircraft  in  the  inner 
clrole  of  the  display  orossed  the  longitudinal  axis  Into  the  western  half  of  the  airspace  in  any 
condition  not  constituting  a  successful  approaoh. 

Within  a  sector,  the  planes  could  fly  at  any  heading  speoifled  by  the  RC  as  long  as  tho 
final  approach  was  made  at  a  heading  of  270  and  a  speed  of  200  kn.  The  RCs  oould  do  simple 
computation?  where  neoessary  to  aid  them  In  directing  their  aircraft.  The  required  approac*. 
rate  (system  orlterlon)  was  an  approach  every  2  min.  A  compensatory  arrangement  was  employed. 
That  is,  a  given  approach  was  to  compensate  for  the  accumulated  time  error.  Hence,  if  a  t'me 
error  of  20  seo.  late  had  acrued  over  prior  approaches,  the  next  approach  was  to  be  20  sec. 
early  so  that  the  average  of  the  approach  times  would  equal  the  system  criterion  of  2  min. 


Fig.  1.  Reproduction  of  the 
display  at  the  start  of  a  session. 
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A  clock  system  was  mounted  on  the  wall  In  front  of  the  team  in  such  a  way  that  the  RCs 
could  keep  continuous  track  of  their  temporal  progress  in  guiding  aircraft  through  the  approach 
gate.  Each  clock  kept  time  in  terms  of  minutes  and  seconds  up  to  1  hour,  and  could  be  viewed  by 
only  a  slight  shift  in  an  RCs  line  of  vision  from  tho  input  display. 

The  following  aspects  of  the  task  characterized  both  team  arrangements:  (a)  A  small  red 

light  indicated  whose  turn  it  was  to  effect  an  approach;  (b)  the  timing  started  upon  the  com¬ 
pletion  of  the  first  approach  of  the  session;  and  (c)  immediate  feedback  was  provided  to  the  RC 

team  of  time  errors  (relative  to  the  compensatory  or  non-compensatory  criteria),  misses,  and 

safety  infractions  immediately  after  each  approach  except  the  first. 


1 


TASK  DESCRIPTION  #3 

SHEET  METAL  WORKER:  USINO  HAND  LEVER  PUNCH 

1.  Narks  point  on  sheet  me  til  where  punch  hole  is  to  be  made. 

2.  Selects  appropriate  punch  and  die  tc  be  us&d. 

3.  Unscrews  die  with  screwdriver  cr  key  furniJhed  with  the  punch. 

4.  Opens  punch  by  lifting  lever. 

3*  Unscrews  threaded  collar. 

6.  Lifts  punch  from  collar  (if  other  one  is  there). 

7.  Inserts  desired  punch  In  collar. 

8.  Screws  on  threaded  collar 

9.  Depresses  lever  to  normal  position. 

10.  Inserts  and  screws  desired  die  into  position. 

11.  Turns  die  so  that  the  end  cf  the  punch  enters  the  die  approximately  l/l6" 
when  levers  are  in  normal  or  closed  position. 

12 .  Opens  punch . 

13.  Inserts  sheet  metal  into  punch. 

14.  Centers  punch  (centering  point  of  punch  is  placed  in  the  prick  point  made 
during  layout) . 

15.  Presses  down  on  lever  to  punch  hole. 

16.  Opens  punch  by  lifting  lever. 

17.  Visually  Inspects  size  and  appearance  of  punched  hole. 
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TASK  DESCRIPTION  # 4 


In  order  to  perform  the  task  to  be  described,  it  is  necessary  to  understand  some  orbital 
dynamics  concepts  . 

See  Figure  1. 

The  first  figure  shows  a  space  vehicle  in  orbit  around  the  earth.  Orbit  1  is  a  circular 
orbit.  If  a  retrograde  or  slowing  down  thrust  is  applied  as  shown  in  the  figure,  elliptical 
trajectories  result.  Orbit  2  is  such  an  ellipse.  As  the  vehicle  falls  toward  the  earth  it 
gains  velocity.  The  Increase  in  velocity  is  sufficient  to  cause  it  to  regain  altitude,  but 
as  it  climbs  it  slows  down  again  resulting  in  the  elliptic  path.  Orbit  3  results  from 
enough  deceleration  to  cause  the  vehicle  to  re-enter  the  atmosphere  before  regaining  suf¬ 
ficient  velocity  to  climb. 

Now  look  at  the  second  figure,  Orbit  1  is  again  a  circular  orbit.  The  thrust  applied 
as  shown  would  cause  the  vehicle  to  accelerate  and  move  into  orbit  2.  This  orbit  is  also  an 
ellipse,  since  as  the  vehicle  gains  altitude,  it  slows  down  and  begins  to  fall.  As  the 
vehicle  falls  it  gains  velocity  and  begins  to  climb  as  in  the  first  case.  If  a  second  thrust 
is  applied  at  the  highest  point  In  the  orbit  (apogee),  shown  by  the  dotted  line,  orbit  3  is 
attained.  This  is  a  circular  orbit  higher  than  orbit  1.  This  is  the  most  efficient  way  to 
change  orbits.  Thrust  Is  used  only  twice,  the  remainder  of  the  time  is  spent  cuasting. 
Similar  two -impulse  transfers  exist  for  any  orbit  charge. 

The  purpose  of  these  figures  is  to  show  what  happens  when  thrust  is  applied  to  an  orbit¬ 
ing  vehicle. 

Now  look  at  figure  3a.  The  circle  with  the  cross  in  it  represents  a  vehicle  in  a 
circular  orbit  around  the  earth.  Part  of  the  earth  can  be  seen  below  the  vehidle.  The 
figure  is  now  centered  on  the  vehicle  and  referenced  to  an  imaginary  line  between  the 
vehicle  and  the  center  of  the  earth.  Thus  the  earth  would  appear  to  turn  under  the  vehicle 
instead  of  the  vehicle  turning  about  the  earth.  The  situation  is  exactly  the  same  in 
Figures  1  and  2,  only  the  view  is  changed.  The  dotted  box  surrounds  the  area  of  interest 
for  one  type  of  rendezvous.  That  is  the  area  ahead  of  and  above  and  below  the  target 
vehicle . 

See  Figure  3b. 

Consider  the  path  of  a  second  vehicle  attempting  to  rendezvous  with  the  target  vehicle. 

If  the  second  vehicle  is  initially  directly  ahead  of  the  target  at  the  same  altitude  and 
speed  (shown  in  Figure  3b)  it  must  slow  down  to  allow  the  target  to  catch  up.  If  the 
interceptor  simply  slows  up  he  will  lose  altitude  and  follow  path  1.  This  path  obviously 
will  not  allow  him  to  rendezvous  with  the  target,  He  must  thrust  upward  to  maintain  his 
altitude  at  the  same  time  that  he  slows  down.  If  the  proper  combination  of  thrusts  are 
applied  he  might  follow  path  2  All  that  would  remain  for  him  to  do  would  be  to  ac¬ 

celerate  to  the  same  velocity  as  the  target  so  that  at  intercept  they  would  have  no  (zero) 
relative  velocity. 

Each  subject  monitors  predictor  display  on  a  cathode  ray  tube.  It  shows  you  the  Inter¬ 
ceptor's  predicted  path  for  a  five  minute  period.  The  right  hand  end  of  the  trace  rep¬ 
resents  the  intercept  or1:*,  present  position.  The  left  hand  end  represents  the  inter¬ 
ceptor]  s  position  five  minutes  in  the  future.  This  trace  a) way:;  represent?*,  a  five  minute 
prediction.  As  you  accelerate  and  decelerate  the  trace  will  appropriately  lengthen  arid 
shorten.  If  the  interceptor  is  stopped  relative  to  the  target,  the  trace  will  become  a 
dot.  The  curvature  of  the  trace  results  from  the  orbital  dynamics,  discussed  above, 
operating  on  the  interceptor]s  velocity  vector. 
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Figure  3o 
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Figure  3b 


TASK  DESCRIPTION  #5 


The  subjects  for  this  experiment  were  four  experienced  pilots  with  various  amounts 
of  helicopter  experience.  The  vehic1  1  was  a  Hiller  model  12-E,  similar  to  the  Army's 

standard  primary  training  helicopter  but  with  an  engine  of  higher  horsepower. 

The  task  chosen  for  the  study  was  a  series  of  four  power  line  patrol  missions  over 
terrain  unfamiliar  to  the  subjects.  Eight  flight  routes  were  chosen,  each  of  which  required 
approximately  two  hours  for  completion;  pilots  flew  two  routes  on  each  experimental  day. 

Each  pilot  flew  the  routes  in  identical  order.  After  driving  to  or  being  flown  to  a 
starting  point,  subjects  were  given  a  map  showing  rural  electric  power  distribution  lines, 
roads  and  certain  other  terrain  details.  A  particular  line  segment,  usually  about  30  miles 
in  length,  was  marked  in  color  on  the  map.  The  pilot  was  required  to  take  off,  locate  the 
beginning  of  the  line  segment  to  be  patrolled,  then  to  fly  at  slow  speed  along  the  line, 
looking  for  damaged  cross  bars,  broken  insulators  or  other  sources  of  potential  power 
interruption. 

At  a  point  unknown  to  the  subject  in  advance,  the  safety  pilot  who  acted  as  observer 
pointed  out  a  tap,  or  terminal  distribution  line,  to  the  subject,  who  was  required  to  turn 
off  the  mainline  and  inspect  the  tap  to  itr  end.  The  subject  then  palled  up  from  the  line, 
returned  at  higher  speed  to  the  main  line  he  had  left  and  continued  his  patrol.  Another  tap 
was  pointed  out  during  the  second  hour  of  flight,  again  without  prior  warning. 

When  the  subject  completed  his  first  route  he  proceeded  to  a  nearby  airport,  landed  and 
refueled.  During  approximately  twenty  minutes  on  the  ground  he  studied  his  next  flight  route 
After  takeoff  he  again  had  to  find  a  line,  patrol  it  and  inspect  another  two  taps  not  marked 
on  his  map. 

The  entire  flight  (except  the  return  from  the  end  of  each  tap  to  the  line  from  which  it 
emanated)  was  conducted  at  altitudes  of  from  20  to  50  feet  and  at  lateral  distances  from  the 
power  lines  of  from  20  to  60  feet.  Pilots  had  to  watch  for  and  avoid  crossing  cables  and 
high  tension  lines,  as  well  as  livestock  which  are  apt  to  stampede  when  frightened  by 
helicopters.  The  power  line  maps  used  were  unfamiliar  to  the  subjects,  as  was  the  terrain. 
The  task  thus  Incorporated  a  navigation  and  detailed  reconna isance  function,  together  with 
intermittent  hazards  which  had  to  be  avoided. 

The  helicopter  was  instrumented  to  allow  monitoring  of  rotor  RPM  a'.id  of  the  positions 
of  throe  controls;  the  collective  pitch  lever,  the  throttle,  and  the  cyclic  pitch  control 
stick.  The  collective  pitch  lever  is  used  to  control  the  pitch  on  all  blades  of  the  rotor, 
to  allow  the  helicopter  to  move  in  an  up  or  down  direction.  The  throttle  of  the  same  type 
ms  on  a  motorcycle,  is  located  near  the  top  part  of  the  lever.  It  provides  the  power  for 
the  engine.  In  order  to  lift  off,  the  pilot,  using  his  left  hand,  pushes  the  lever  forward 
to  increase  the  pitch  while  at  the  same  time,  he  presses  on  the  throttle  to  provide  the 
necessary  power.  The  cyclic  pitch  control  stick  is  used  to  control  the  pitch  of  each  blade 
individually,  to  allow  the  helicopter  to  move  in  any  direction  other  than  up  or  down.  The 
stick  is  operated  with  the  right  hand. 

As  noted,  each  subject  flew  the  four  missions  in  the  same  order.  The  first  and  second 
days  of  flying  were  in  relatively  hilly  terrian,  whereas  the  third  and  fourth  days  were 
over  generalxy  flat  farmland. 
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The  dot  on  the  left  represents  the  target  vehicle.  At  the  start  of  each  rendezvous 
maneuver  the  Interceptor  will  be  80,000  feet  ahead  and  20,000  feet  above  the  target.  The 
scale  on  the  display  Is  1  Inch  -  10,000  feet.  The  task  Is  to  rendezvous  with  the  target  * 
within  1 5  minutes  using  as  little  fuel  as  possible. 

At  the  beginning  of  each  run  the  initial  Impulse  of  a  two-impulse  transfer  has  been 
Initiated  but  not  so  the  subject  will  coast  along  the  best  trajectory.  The  subject  Is  to 
correct  the  orbital  path  with  this  controller  and  continue  to  "fly"  to  the  target  and 
stsp  the  Interceptor  at  the  target.  In  order  to  accelerate  the  Interceptor  In  a  specific 
direction,  the  subject  displaces  the  control  stick  in  that  same  direction.  The  more  the 
stick  Is  displaced  the  more  thrust  that  Is  applied.  To  aid  the  subject  In  stopping  at  the 
target  the  scale  Is  expanded  when  the  Interceptor  gets  close  to  the  target.  When  a  range 
of  10,000  feet  Is  reached  (1  Inch  from  the  target)  the  scale  will  be  expanded  to  1  Inch  ■ 
1,000  feet. 

The  interceptor  is  to  be  flown  to  the  target,  until  the  dots;  touch;  then  the  subject 
stops  the  Interceptor.  He  is  to  use  as  little  fuel  as  possible  and  make  his  rendezvous 
within  15  minutes. 


i 


i 
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TASK  DESCRIPTION  #6 


f 

Bill,  a  21  year  old  senior,  plays  basketball  for  Artichoke  University. 

He  is  team  c&ptain  and  plays  center  since  he  is  the  tallest  man  on  the 
team.  During  the  last  game  he  scored  34  points  and  got  17  rebounds. 

Parts  of  the  game  went  as  follows:  On  the  opening  jump,  Bill  tapped 
the  ball  to  one  of  his  team-mates,  they  ran  down  the  court  and  Bill  was 
fouled  in  the  process  of  shooting.  Bill  made  both  of  his  foul  shots.  The 
other  team  took  the  ball  out  of  bounds  and  passed  back  and  forth  to  each 
other  looking  for  a  good  shot.  Bill  anticipated  one  of  the  passes  and 
lunged  for  the  ball  which  he  knocked  out  of  bounds.  After  the  other  team 
scored,  there  was  a  fast  break  and  Bill  dribbled  down  the  length  of  the 
court.  He  faked  out  two  opponents  and  went  in  for  the  lay-up. 

There  were  very  few  fouls  in  the  first  quarter  and  the  players  were 
constantly  on  the  run. 


t 
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Task  Description  Number 


ANSWEP  SHEET 


ability  # 


HIGH 


LOW 


o  DOES  NOT  APPLY 


ABILITY  #. 


HIGH 


LOW 


a  DOES  NOT  APPLY 


ABILITY  # 


HIGH 


LOW 


ABILITY  # 


HIGH 


LOW 


□  DOES  NOT  APPLY 


□  DOES  NOT  APPLY 


TASK  DESCRIPTION  RATING  SCALES 


1.  Degree  to  which  you  understood  the  task  description 


Very  Poor 

Completely  unable  to 
understand  the  task 
and  what  it  requires 
of  the  subject* 


Fair 

Understanding 


2.  Completeness  of  Task  Description 


Very  Poor 

Not  enough  detail  pro¬ 
vided  to  make  meaningful 


Fairly 

Complete 


ratings  of  the  task  or  to 


permit  comprehension  of 
the  task 


3.  Clarity  of  Task  Description 


Very  Poor 

^Description  of  task  confusing 


Fairly  Clear 


and  difficult  to  follow. 


^  Terminology  imprecise  or 
ambiguous. 
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fi  r.taiMMrtl iite 


kwiit* 


Very  Complete 
All  necessary  detail 
provided  for  full 
comprehension  of  the 
task . 


Thoroughly  Understood 
Including  complete 
comprehension  of 
all  of  the  details. 


Extremely  Clear 
Task  description  is 
very  lucid  and  easy  to 
follow.  All  terminology 
is  precise  and  un¬ 
ambiguous. 


4.  Degree  of  Familiarity  with  the  task 


I 

Not  at  all 

Know  no  more  about 
the  task  than  is  pre¬ 
sented  in  the  task  de¬ 
scription 

1 

» 

i 

i 

! 


Fairly 

Familiar 


Thoroughly  familiar 
Know  all  about  the 
basic  including  all 
of  the  details 


5.  Source  of  Familiarity 
(Check  one  or  more) 

4 

Reading  / _ / 

Have  seen  others  perform  the  task  / _ / 

Have  performed  the  task  personally  / _ / 


6.  Degree  of  personal  experience  in  performing  the  task 


None  at  all 
lave  never  attempted 
the  task 


Fairly  expe-  Thoroughly  experienced 

rienced  Have  performed  the  ^ 

task  on  very  many 


occasions 


-210- 


r 


7.  If  you  have  experience  on  the  task 
Degree  of  proficiency  on  the  task 


1  1 

i  i 

1  1  1 

1  1 

Not  at  all 
Proficient 
Can  perform  the 
task  only  at  an 
extremely  low 
level 


Fairly  proficient  Highly  proficient 

Performance  on  the 
task  is  essentially 
perfect 


1 

i 

j 
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II  AU&TRACT 

A  major  problem  which  confronts  the  behavioral  sciences  is  the  lack  of  a 
unifying  set  of  dimensions  for  describing  human  task  performance.  The  absence 
of  such  a  system  limits  the  ability  to  relate  human  performance  observed  in  one 
task  to  that  observed  in  similar  tasks.  There  is  a  need  for  a  well-defined  task- 
descriptive  language  for  use  by  those  who  must  apply  the  results  of  research  to 
operational  tasks.  This  report  describes  one  of  several  approaches  under  de- 
velopment  as  part  of  a  larger  program;  the  approach  is  concerned  with  developing 
a  task  classification  system  based  upon  known  parameters  of  human  performance. 
The  human  abilities,  upon  which  this  system  was  based,  were  derived  primarily 
from  the  reported  factor  analyses  of  human  performance  in  the  cognitive,  psycho- 
motor,  physical,  perceptual,  and  sensory  a^eas.  Definitions  of  the  abilities  were 
developed  together  with  rating  scales  for  each  ability.  A  series  of  pilot  studies 
then  were  undertaken  with  the  objective  of  producing  an  instrument  which  would 
have  high  reliability  in  classifying  human  tasks.  During  these  exploratory  studies, 
the  initial  set  of  human  abilities  was  modified,  the  definitions  of  the  abilities  were 
revised,  and  the  rating  technique  was  improved  upon.  In  addition,  the  studies 
examined  various  methods  of  analyzing  the  reliability  data,  and  compared  two 
methods  of  anchoring  the  rating  scales.  The  results  of  this  pilot  research  indi¬ 
cated  that  it  was  possible  to  develop  a  set  of  reliable,  ability-based  scales  for 
_ _ _ _ _ _ _ _  (Continued) 
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13.  Abstract  (Continued) 

classifying  tasks,  although  more  work  will  be  needed.  Future  research  on 
a  human  ability  approach  to  classification  will  continue  with  the  investigation 
of  the  problems  of  scale  reliability  and  will  initiate  recearch  on  questions  of 
the  validity  of  the  classificator y  instrument. 
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